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This  research  is  a  preliminary  study  with  two  major  objectives.  The  first  is  to 
perform  a  literature  survey  of  the  oroblem  solving  and  artificial  intelligence 
literature  relevant  to  Navy  needs.  The  second  objective  is  to  investioate  aoproaches 
to  problem  solving  that  could  be  taught  to  Naval  officers  for  use  in  their  jobs. 

This  survey  has  found  a  growing  interest  in  the  area  of  problem  solvinn.  This 
interest  began  with  work  in  cognitive  psychology  and  artificial  intellinence  in  the 
1950's  and  gradually  spread  to  influence  education  and  manaaement.  There  is  little 
evidence  in  the  literature  to  indicate  that  teaching  generic  problem  solvinn  oroduces 
improvement  in  problem  solving  abilities.  One  factor  complicatino  this  is  the  lack 
of  adequate  definitions  of  problem  solving  skills  and  the  lack  of  test  instruments 
to  measure  these  skills.  Some  authors  suggest  that  oeneric  problem  solving  skills 
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are  best  taught  in  the  context  of  more  conventional  courses.  The  work  in 
teaching  generic  problem  solving  is  still  largely  exploratory  and  unvalidated 
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SUMMARY 


Problem 

In  assigning  officers  to  jobs,  the  Navy  has  a  general  management 
philosophy.  An  officer  is  expected  to  handle  any  management  situation. 
General  skills  are  regarded  as  more  important  than  specialized  training. 
This  can  mean  that  an  officer  may  have  several  months  of  unproductive 
learning  time  before  mastering  the  skills  needed  for  a  new  assignment. 
If  officers  could  be  given  a  set  of  useful  general  problem  solving  skills, 
it  is  possible  that  this  learning  time  could  be  shortened.  , 

Objective 

» 

This  research  is  a  preliminary  study  with  two  major  objectives.  The 
first  is  to  perform  a  literature  survey  of  the  problem  solving  and  artifi¬ 
cial  intelligence  literature  relevant  to  Navy  needs.  The  second  objective 
is  to  investigate  approaches  to  problem  solving  that  could  be  taught  to 
Naval  officers  for  use  in  their  jobs. 

Approach  ' 

This  preliminary  study  is  a  literature  survey  and  problem  structur¬ 
ing  effort.  The  study  of  problem  solving  is  spread  across  many  disci¬ 
plines,  and  the  first  step  is  to  investigate  this  literature. 

Results  and  Conclusions 

This  survey  has  found  a  growing  interest  in  the  area  of  problem 
solving.  This  interest  began  with  work  in  cognitive  psychology  and 
artificial  intelligence  in  the  1950's  and  gradually  spread  to  influence  ed¬ 
ucation  and  management.  There  is  little  evidence  in  the  literature  to 
indicate  that  teaching  generic  problem  solving  produces  improvement  in 
problem  solving  abilities.  One  factor  complicating  this  is  the  lack  of 
adequate  definitions  of  problem  solving  skills  and  the  lack  of  test  in¬ 
struments  to  measure  these  skills.  Some  authors  suggest  that  generic 
problem  solving  skills  are  best  taught  in  the  context  more  conventional 
courses.  The  work  in  teaching  generic  problem  solving  is  still  largely 
exploratory  and  unvalidated. 


Future  Research  Considerations 

There  is  a  need  for  both  theoretical  and  applied  research  in  problem 
solving.  Topics  of  interest  include: 

1.  Design  of  measures  of  problem  solving  skills. 

2.  Design  of  course  modules  in  problem  solving  covering  both  do¬ 

main  specific  and  general  skills. 

3.  Experiments  where  the  usefulness  of  teaching  problem  solving 

skills  is  tested. 

4.  Studies  of  computers  and  human  problem  solving.  These  should 

focus  on  the  computer  as  a  problem  environment  and  ways  in 
which  the  computer  can  aid  human  problem  solving. 
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I 

INTRODUCTION 


A  long  standing  issue  in  problem  solving  is  whether  general  prob- 
I  lem  solving  techniques  offer  a  useful  alternative  to  domain  specific 

I  problem  solving  techniques.  Early  researchers  in  cognitive  psychology 

and  artificial  intelligence  concentrated  on  general  problem  solving 
[Feigenbaum  and  Feldman,  1963;  Newell  and  Simon,  1972].  More  recent 
work  has  dealt  with  knowledge  based  systems  and  expert  systems  which 
use  these  general  techniques  but  apply  them  to  specific  prqblem  domains 
[Barr  and  Feigenbaum,  1981;  Barr  and  Feigenbaum,  1982;  Cohen  and 
I  Feigenbaum,  1982].  After  thirty  years  of  research,  the  issues  are  still 

far  'from  being  resolved. 

If  generic  problem  solving  skills  can  be  successfully  taught,  this 
could  be  valuable  in  the  education  of  Naval  officers.  Due  to  frequent 
personnel  rotation.  Navy  officers  are  asked  to  solve  problems  and  make 
I  decisions  in  areas  where  they  have  little  initial  knowledge  of  the  subject 

matter.  A  useful  set  of  generic  problem  solving  skills  could  be  of  great 
benefit  to  the  Navy  and  individual  officers.  These  skills  could  be 
used  to  reduce  the  time  required  to  get  an  officer  up  to  speed  in  a  new 
assignment.  The  idea  of  teaching  generic  problem  solving  skills  is 
not  new.  Courses  are  in  place  at  several  universities,  and  there  is  a 
I  growing  literature  [Rubenstein,  1980;  Hayes,  1981].  This  work  still 

'  must  be  regarded  as  preliminary,  however. 

The  objective  of  this  study  is  to  better  understand  problem  classes 
and  related  solution  strategies.  To  bound  the  requirement,  we  will  fo¬ 
cus  on  the  question  of  problem  analysis  instead  of  on  specific  problem 
I  solving  skills  in  any  domain.  The  most  important  step  in  any  type  of 

problem  solving  is  to  recognize  and  classify  the  problem.  Only  then 
can  an  individual  bring  specific  problem  solving  techniques  to  bear. 

The  approach  taken  will  be  to  survey  the  literature  in  problem  solv¬ 
ing,  to  develop  a  model  of  the  problem  solving  process  and  to  identify 
I  candidates  for  teaching  and  future  research.  In  most  courses,  solution 

strategies  are  cognitively  tied  to  the  context  in  which  they  were 
learned.  This  can  cause  their  applicability  to  other  domains  to  be 
overlooked.  Thus,  the  aim  of  any  instruction  in  generic  problem  solv¬ 
ing  is  to  get  the  pr  btem  solver  to  see  solution  techniques  as  general 
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methods  that  can  be  used  in  a  variety  of  contexts.  The  hope  is  that  a 
person  who  knows  how  to  remove  skills  from  a  context  will  be  a  more 
successful  problem  solver  in  a  variety  of  domains. 

One  item  of  interest  for  follow  on  work  is  the  extent  to  which  dif¬ 
ferent  modes  of  computer  access  can  be  helpful  in  structuring  and  solv¬ 
ing  problems.  Computers  have  great  potential  in  aiding  human  problem 
solving.  Some  of  the  earliest  work  in  artificial  intelligence  grew  out  of 
attempts  by  cognitive  psychologists  to  simulate  human  problem  solving 
processes  on  computers.  This  work  led  to  increased  understanding  of 
both  humans  and  computers. 


1.1  PROBLEM  SOLVING  AND  NAVY  CAREER  PATTERNS 

A  typical  Naval  officer's  career  is  likely  to  involve  nr|any  different 
jobs  and  types  of  responsibility.  The  Navy  is  not  a  single  monolithic 
entity  but  is  divided  into  many  different  communities  and  warfare  spe- 
cialfies.  Examples  would  include  such  areas  as  supply,  surface  war¬ 
fare,  anti-submarine  warfare,  submarines,  aviation  and  so  on.  An  offi¬ 
cer's  career  begins  in  a  particular  community.  Even  within  a 
community,  there  is  wide  variation  in  jobs.  An  officer  may  start  in  op¬ 
erational  jobs  and  then  move  on  to  supervisory  (e.g.  department  head) 
and  managerial  jobs  (e.g.  executive  officer).  At  higher  levels  in  the 
Navy,  an  officer  may  be  transferred  from  the  community.  This  kind  of 
shift  requires  that  abandoning  the  narrower  perspective  of  the  commu¬ 
nity  and  warfare  specialty  and  instead  viewing  things  from  a  Navy-wide 
perspective. 


1.2  THE  STUDY  OF  GENERAL  PROBLEM  SOLVING 

Considering  that  human  beings  have  been  problem  solvers  for  all 
their  existence,  the  actual  study  of  problem  solving  has  a  short  histo¬ 
ry.  Problem  solving  has  been  viewed  as  an  art.  You  were  either  good 
at  it  or  you  were  not.  Little  effort  was  made  (or  is  being  made)  to 
teach  problem  solving  as  such.  Most  teaching  is  directed  at  domain 
specific  skills.  Examples  of  successful  solution  strategies  are  present¬ 
ed,  and  students  are  expected  to  emulate  these  strategies. 

An  exception  to  this  approach  was  Guorg  Polya's  How  to  Solve  It,  a 
classic  book  of  solution  strategies  for  mathematical  problems.  Polya  laid 
out  the  problem  solving  process  as  a  series  of  steps.  These  are  given 
in  Figure  1.  Polya's  book  offered  many  helpful  examples  for  using  this 
approach.  The  methods  he  used  were  actually  quite  general,  but  the 
domain  was  limited  to  mathematics. 


2.3  THE  OFFICER  AS  GENERAL  MANAGER 


The  normal  career  path  for  a  Naval  officer  includes  assignment  as  a 
department  head,  executive  and  commanding  officer,  and  ultimately  a 
major  shore  command.  Although  an  officer  receives  the  extensive  tech¬ 
nical  training  within  a  warfare  specialization,  only  a  relatively  short 
period  of  time  is  spent  functioning  in  this  specialty.  Officers  rotate 
every  two  or  three  years  between  their  military  specialty  and  managerial 
support  positions.  As  an  officer's  career  progresses,  increasing  amounts 
of  time  are  devoted  to  management  functions. 


2.4  MANAGEMENT  TRAINING  PROGRAMS 

To  date,  the  only  formal  training  a  Naval  officer  receives  to  develop 
managerial  skills  is  the  Leadership  and  Management  E,ducation  and 
Training  (LMET)  program,  which  is  offered  to  officers  of  any  rank,  and 
two  other  courses  for  incumbent  senior  officers  of  major  shore  command 
billets,  through  the  Naval  Civilian  Personnel  Command  [Hodges,  1981; 
Vandover,  1981 ] . 


2.4.1  Leadership  and  Management  Education  and  Training 

The  LMET  training  program  was  developed  by  McBer  and  Company 
based  on  McClelland’s  theoretical  concepts  and  research  on  leadership 
and  achievement.  The  program  was  formally  implemented  in  1978  and 
currently  has  five  levels  of  managerial  training.  The  levels  of  training 
differ  mainly  in  the  content  and  the  context  corresponding  to  the  type 
of  managerial  setting  encountered  under  the  position  as  commanding  of¬ 
ficer  or  executive  officer,  department  head,  division  officer,  chief  petty 
officer  or  petty  officer.  The  instruction  period  is  10  working  days.  On 
the  east  coast,  the  LMET  is  offered  in  Memphis,  Tennessee;  Little 
Creek,  Virginia;  New  London,  Connecticut;  Mayport,  Florida;  Pensaco¬ 
la,  Florida;  Newport,  Rhode  Island;  Charleston,  South  Carolina.  On 
the  west  coast,  the  LMET  course  is  offered  in  Coronado,  California; 
San  Diego,  California;  Bangor,  Washington;  Treasure  Island,  California; 
and  Pearl  Harbor.  Officers  typically  have  the  opportunity  to  receive 
the  LMET  training  enroute  to  their  new  duty  stations. 
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As  an  officer's  career  progresses  through  the  assignments  of  sea  or 
squadron  and  shore  tour,  those  achieving  higher  ranks  eventually  as¬ 
sume  a  major  shore  or  staff  command.  The  job  of  the  Commanding  Offi¬ 
cer  is  to  manage  Naval  support  and  operational  forces.  Major  com¬ 
mands  involve  the  senior  Naval  officer  in  the  management  of  activities 
not  particularly  related  to  their  warfare  specialty. 

A  guidebook  on  Navy  careers  [Naval  Military  Personnel  Command, 
1979]  provides  a  general  outline  of  for  the  several  officer  types.  The 
typical  career  patterns  for  the  Surface  Warfare,  Aviation,  and  the  Nu¬ 
clear  Surface  Warfare  Officers  are  illustrated  in  Figures  2,  3,  4,  and  5 
of  this  report.  The  major  steps  of  a  line  officer’s  career  pattern  were 
summarized  in  a  Master's  thesis  at  the  Naval  Postgraduate  School  as  fol¬ 
lows: 

a.  Major  shore  command  assignment  on  or  about  the 

22-year  mark;  , 

b.  Generally,  over  50%  of  time  in  service  will  be  afloat  or 
squadron  units  or  in  training  for  those  units  (for  offi¬ 
cers  in  paths  shown  in  Figures  2,  3,  4,  and  5); 

c.  The  likelihood  of  Washington  shore  assignment  for  sen¬ 

ior  officers  (0-4  and  above);  and 

d.  The  predominance  of  subspecialty  and  staff  duty  for 
shore  duty  assignments*. 

For  the  Restricted  and  Staff  Officers,  the  career  patterns  are  much 
more  specific  to  their  designator.  However,  as  with  the  Unrestricted 
Line  communities,  these  officer  also  rotate  through  assignments  relevant 
to  their  specialty  and  management  support  positions. 


*  James  V.  Hodges  and  B.  Rosakranse,  Analysis  of  Training  for  Pro¬ 
spective  Commanding  Officers  of  Major  Shore  Activities ,  1981,  p.  38. 
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4.  Special  Warfare  Officers,  designator  1130 

5.  Aviation  Warfare  Officers,  designator  1300 

6.  Restricted  Line  and  Special  Duty  Officers,  designator  -  various 

7.  Staff  Corps  Officers,  designator  -  various 

Within  each  of  the  warfare  categories  (designator  groupings)  are  job 
specializations,  which  are  distinguished  by  the  last  two  digits  of  the 
designator  code  (e.g.  Pilot  (1310),  Flight  Officer  (1320)).  Officers  in  a 
warfare  specialty  will  further  subspecialize  into  non-warfare  areas. 
Each  of  the  subspecialty  areas  receives  an  additional  designator  code 
listed  under  the  Navy  Officer  Codes  System. 

The  Naval  officer's  career  evolves  through  a  progression  of  duty 
and  training  assignments.  The  career  pattern  is  to  some  extent  fixed 
once  the  newly  commissioned  officer  commits  to  a  particular  specializa¬ 
tion  within  a  designator.  The  career  patterns  of  Unrestricted  Line  Offi¬ 

cers  in  surface,  aviation  and  submarine  communities  are  established  by 
following  the  prescribed  series  of  sea  or  squadron  and  shore  billets  ap¬ 
propriate  for  success  within  each  community.  The  first  duty  is  typical¬ 

ly  operational.  The  junior  line  officer  is  assigned  a  sea  or  squadron 
tour  which  involves  extensive  training  and  experience  in  the  warfare 
specialty.  The  goal  here  is  to  develop  the  officer's  knowledge  of  the 
sea  or  squadron  operations,  equipment  and  warfare  tactics.  Emphasis 
is  placed  on  performing  those  duties  that  lead  to  the  largest  gain  in 
knowledge  and  on-the-job  training  in  the  specialty.  Assignments  to 
various  duties  are  selected  to  build  and  reinforce  the  officer's  opera¬ 
tional  experience  in  a  particular  warfare  specialty.  Duty  assignments 
are  also  diversified  with  the  expressed  intent  to  cross  train  the  officer 
to  become  proficient  and  knowledgeable  across  the  spectrum  of  naval 
operations.  A  major  goal  of  an  officer  is  to  obtain  the  command  billets 
of  Executive  and  finally  Commanding  Officer  of  a  ship  or  squadron. 

The  shore  duty  assignments  generally  remain  operationally  oriented 
but  are  more  varied  and  open  to  be  tailored  to  the  officer's  particular 
specialty  interests.  Shore  tours  are  designed  to  enhance  the  value  of 
the  officer  to  the  Navy  and  train  the  officer  to  function  at  higher  levels 
within  its  organizational  structure.  The  officer  receives  either  additional 
formal  training  ashore  or  is  assigned  a  special  staff  position.  For  the 
first  shore  tour  of  duty,  the  officer  will  choose  a  subspecialty  which 
will  determine,  for  the  most  part,  future  assignments  ashore.  Some  of 
the  possibilities  for  shore  tours  include  postgraduate  education,  service 
college,  staff  duty,  training  instructor,  or  recruiting  assignment. 
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JOB  REQUIREMENTS  FOR  NAVAL  OFFICERS 


2.1  NAVAL  ORGANIZATION 

The  Navy  is  organized  into  operating  forces  and  supporting  shore  ac¬ 
tivities.  The  operating  forces  are  comprised  of  ships,  aircraft,  and  Ma¬ 
rine  combat  units,  which  have  combat  and  seagoing  readiness  require¬ 
ments  whether  they  are  based  ashore  or  at  sea  [Price,  1973].  The 
primary  function  of  shore  activities  is  to  supply,  maintain  and  support 
the  Navy's  operating  forces  by  obtaining  material,  services  and  person¬ 
nel.'  The  career  Naval  officer,  who  achieves  the  higher  ranks,  will  com¬ 
mand  both  operating  and  shore  activities.  The  next  section  describes 
the  career  pattern  of  a  Naval  officer.  It  is  important  to  note  that  the 
Naval  officer  has  dual  responsibilities.  The  officer  is  trained  an  oper¬ 
ational  job  (e.g.  fighter  pilot  or  Weapons  Officer)  and  at  the  same  time 
must  be  a  general  manager,  tending  to  the  administrative  needs  of  the 
operating  forces. 


2.2  NAVAL  OFFICER  CAREER  DEVELOPMENT 

The  general  career  pattern  for  the  Naval  officer  varies  with  the 
type  of  officer.  Under  the  U.  S.  Code,  Title  110,  all  officer  classifica¬ 
tions  and  their  billets  correspond  to  a  four  digit  designator  code.  Sev¬ 
en  major  officer  categories  can  be  identified They  are: 

1.  Undesignated  Officers,  designator  1100 

2.  Surface  Warfare  Officers,  designator  1110 

3.  Submarine  Warfare  Officers,  designator  1120 
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Shepherd,  Career  Planning  Information  in  Officer  Professional  Devel¬ 
opment,  1974,  p.13. 


The  important  point  in  understanding  and  teaching  problem  solving 
is  to  develop  an  overall  model  of  the  process,  to  teach  problem  solving 
as  a  process  that  can  be  decomposed  into  parts,  to  teach  the  process 
of  decomposition,  and  to  teach  each  of  the  parts  of  the  process.  This 
requires  much  understanding  and  practice  from  both  students  and 
teachers.  It  is  not  clear  if  it  has  ever  really  been  tried.  Most  of  us 
think  that  we  are  teaching  "problem  solving"  whatever  our  specialty 
may  be.  In  fact,  most  of  us  are  experts  in  one  domain  or  another,  and 
we  do  not  bring  a  great  deal  of  true  generality  to  the  process.  This  is 
the  challenge  in  teaching  general  problem  solving.  Whether  it  can  be 
carried  out  successfully  is  an  unproved  proposition. 


different  areas  in  a  business  so  that  they  could  call  for  specialists  when 
necessary. 


The  paper  above  had  certain  flaws.  The  authors  seem  to  come  from 
an  organizational  theory  or  organizational  design  background.  Their 
taxonomy  of  problems  and  solutions  was  highly  detailed  in  these  areas. 
Other  areas  of  management  that  are  equally  complex  received  one  phrase 
dismissals  (operations  research  or  management  information  systems). 
Mark  Twain's  comment  about  everything  looking  like  a  nail  to  a  man  who 
only  has  a  hammer  seems  appropriate  here.  But  even  if  their  taxono¬ 
my  had  been  expanded,  problems  would  remain.  Problem  taxonomies 
completely  ignore  issues  of  problem  finding  and  choice  of  representa¬ 
tion.  Before  one  can  call  in  the  experts,  one  must  decide  that  some¬ 
thing  is  a  problem.  The  problem  must  be  represented  in  a  certain  way. 
By  the  time  one  calls  in  the  experts,  much  of  the  important  problem 
solving  work  has  been  done. 

If  one  had  to  lay  out  the  skills  for  problem  solvers,  the  choices 
would  have  to  go  beyond  a  simple  taxonomy.  Choices  would  include: 

1.  Understanding  skills. 

A  good  problem  solver  must  be  able  to  look  at  a  situation  in 
many  different  ways.  Such  a  person  must  have  a  rich  variety 
of  representations  for  problems  and  know  how  to  apply  them  in 
many  different  problem  domains. 

2.  Problem  finding  skills. 

It  might  seem  that  problem  finding  is  unnecessary  since  prob¬ 
lems  are  usually  thought  of  as  forcing  themselves  on  our  atten¬ 
tion.  Actually,  one  issue  is  what  we  should  consider  the  prob¬ 
lem  to  be  in  a  given  situation.  This  relates  to  the  previous 
point  of  choice  of  representation. 

3.  Problem  structuring  skills. 

Once  confronted  with  a  problem,  a  problem  solver  must  be  able 
to  structure  the  problem  in  such  a  way  that  it  can  be  solved. 

4.  Analytic  skills. 

These  are  the  heuristics  and  other  methods  for  solving  prob¬ 
lems  that  the  cognitive  psychologists  and  artificial  intelligence 
researchers  study. 

5.  Knowledge  base. 

To  be  able  to  solve  problems,  a  person  should  have  a  base  of 
knowledge  in  the  problem  domain  under  consideration.  This 
knowledge  should  be  structured  so  that  it  is  accessible  and  can 
be  used  in  the  solution  process. 
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One  can  find  many  similar  examples.  If  you  go  into  a  mathematics 
library  that  dates  back  into  the  nineteenth  century,  you  will  find  many 
large  volumes  of  algebra  books  that  deal  with  the  theory  of  determi¬ 
nants.  These  books  detail  all  the  tricks  for  dealing  with  determinants 
that  we  learned  in  Algebra  I  many  more  besides.  All  that  is  gone  to¬ 
day.  The  work  is  still  as  valid  as  it  ever  was.  The  advent  of  digital 
computers  has  simply  made  the  use  of  tricks  with  determinants  unneces¬ 
sary  for  solving  large  systems  of  equations. 

One  approach  that  has  been  taken  lately  in  the  teaching  of  problem 
solving  is  to  concentrate  on  developing  problem  finding  and  representa¬ 
tion  skills.  The  theory  seems  to  be  that  these  skills  are  left  undevel¬ 
oped  by  conventional  teaching  techniques  or  even  that  these  skills  are 
discouraged.  This  is  the  approach  taken  by  Edward  DeBono  in  his 
creativity  courses.  DeBono  uses  a  variety  of  techniques  to  encourage 
subjects  to  try  new  approaches  to  problems.  He  tries  to  discourage 
what  he  calls  "vertical  thinking"  by  which  he  seems  to,  mean  rigidly 
structured  linear  approaches  to  problem  solving.  He  offers  what  he 
calls  "lateral  thinking"  as  an  alternative.  By  this,  he  means  the  use  of 
techniques  which  try  to  search  out  alternatives  early  in  the  problem 
solving  process.  His  techniques  rely  heavily  on  brainstorming.  In  some 
ways,  they  seem  to  resemble  Dada,  the  modern  art  movement  of  the 
1920’s  espoused  by  Salvador  Dali.  One  aim  of  Dada  was  to  encourage  a 
greater  sensitivity  to  beauty  by  presenting  images  that  were  deliberate¬ 
ly  shocking.  In  the  same  way,  DeBono  suggests  posing  "silly"  solu¬ 
tions  to  problems  to  help  break  out  of  preconceived  notions  of  what  is 
right.  ' 

DeBono's  work  is  widely  touted  to  executives  and  seems  to  achieve  a 
certain  degree  of  success.  Academics  are  less  excited  about  it,  no 
doubt  partly  because  of  DeBono’s  style.  He  does  not  give  credit  to 
others  for  portions  of  his  work  which  is  derivative.  The  book  is  written 
in  a  generally  pompous  and  authoritative  tone.  His  approaches  to 
problem  finding  and  structuring  are  probably  worth  considering.  They 
are  far  from  a  complete  approach  to  problem  solving.  But,  they  do  offer 
guidance  in  the  initial  stages  of  problem  solving  where  people  seem  to 
need  some  encouragement. 

Another  way  to  view  problem  solving  is  as  a  set  of  different  domains 
that  are  best  handled  by  specialists.  If  the  problem  solver  is  a  manag¬ 
er,  then  his  function  should  be  to  know  enough  about  the  different  do¬ 
mains  to  be  able  to  call  in  the  proper  expert.  This  was  the  approach 
taken  in  a  paper  written  for  the  Naval  Personnel  Research  and  Develop¬ 
ment  Center  [Doherty,  et.  al.,  1980].  This  is  similar  to  the  approach 
taken  by  many  MBA  programs.  The  manager  is  viewed  as  a  generalist 
whose  function  is  to  lead,  to  motivate,  and  to  know  when  to  call  in  the 
experts.  The  educational  process  makes  the  students  familiar  with  the 
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In  more  recent  years,  this  approach  has  changed.  Artificial  intelli¬ 
gence  has  moved  in  the  direction  of  knowledge  based  systems  and  ex¬ 
pert  problem  solvers  which  operate  in  limited  domains  (actually,  GPS 
operated  in  limited  domains  as  well,  but  its  ambitions  were  much  broad¬ 
er).  There  are  many  examples  of  expert  or  knowledge  based  systems. 
Two  such  systems  are  MYCIN  which  does  infectious  disease  diagnosis 
and  PROSPECTOR  which  aids  in  the  discovery  of  mineral  deposits  [Barr 
and  Feigenbaum,  1981].  The  domain  specific  problem  solvers  do  not 
represent  a  rejection  of  the  earlier  general  problem  solvers.  They 
build  on  the  earlier  work  using  the  same  heuristics  for  analyzing  prob¬ 
lems.  They  extend  it  by  using  more  sophisticated  methods  for  struc¬ 
turing  knowledge  and  more  special  purpose  heuristics. 

The  most  important  thing  is  to  develop  a  model  of  the  problem  solv¬ 
ing  process  and  then  try  to  decide  what  pieces  of  the  model  should  be 
taught.  One  such  model  might  be: 

1.  Choose  a  problem. 

2.  Choose  a  representation  for  the  problem. 

3.  Choose  a  solution  method  for  your  problem  and  representation. 

4.  Evaluate  the  solution  method  at  each  point. 

5.  Evaluate  the  result  and  recycle  if  necessary. 

Various  approaches  to  problem  solving  will  concentrate  on  one  or  an¬ 
other  of  these  steps.  Traditional  courses  typically  focus  on  the  last 
two  points.  The  problem  and  the  representation  are  already  chosen  for 
you.  What  matters  is  applying  the  solution  method  (e.g.  the  one  in  the 
book)  and  evaluating  it  (getting  the  "right"  answer).  This  can  be  un¬ 
fortunate  since  it  obstructs  one's  ability  to  generalize  to  different  prob¬ 
lem  domains.  This  would  seem  to  be  the  case  in  the  "real"  world.  There 
are  numerous  papers  that  document  the  lack  of  transfer  effects  in 
problem  solving  [e.g.  Sweller,  1980]. 

There  seems  to  be  ample  evidence  that  much  can  be  gained  by  con¬ 
centrating  on  the  first  two  points  of  this  model,  namely  the  issues  of 
problem  finding  and  representation.  Often,  a  problem  can  be  solved  by 
recasting  it  in  different  terms.  As  an  example,  in  the  Middle  Ages,  it 
was  believed  that  by  diligent  study,  a  university  student  should  be 
able  to  master  the  art  of  long  division,  something  that  is  normally 
taught  in  the  third  or  fourth  grade  now.  The  problem  was  not  that  the 
medievals  were  any  less  intelligent  than  we  are  -  they  weren't.  They 
just  had  to  cope  with  long  division  using  Roman  numerals.  Changing 
the  representation  of  the  problem  caused  the  problem  to  disappear. 
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The  interest  in  general  problem  solving  can  also  be  found  in  the 
educational  psychology  literature  [Baird,  1983;  Bourne,  1970;  Feldhu- 
sen,  et.  al.,  1972,  1975,  1979,  1980;  Genya,  1983;  Houtz  et.  al.,  1973; 
Karat,  1982;  Lukas,  et.  al.,  1971;  Pitt,  19^;  Post  and  Brennan,  1976; 
Reif  and  Heller,  1982;  Schwieger,  ir‘'4;  Speedie,  et.  al.,  1973;  Thor- 
son,  1977  and  Tuma  and  Reif,  1980].  Most  of  these  papers  deal  with 
experiments  in  teaching  problem  solving.  There  is  little  in  the  way  of 
formal  validation  in  the  papers.  This  is  not  surprising  since  there  is 
no  generally  accepted  measure  of  problem  solving  ability  although  we 
were  surprised  to  find  that  there  are  some  attempts  to  measure  this 
ability.  One  such  test  instrument  is  the  Purdue  Elementary  Problem 
Solving  Inventory  [Purdue,  1973].  This  test  is  aimed  at  elementary 
school  students  of  different  socioeconomic  backgrounds.  It  is  only  par¬ 
tially  relevant  to  this  study. 

There  are  many  questions  about  the  teaching  of  problem  solving. 
These  would  include: 

1 .  What  is  general  problem  solving? 

2.  How  is  problem  solving  ability  measured? 

3.  Is  the  course  effective  in  improving  problem  solving  ability  us¬ 

ing  some  measure? 

These  questions  are  not  answered  by  any  of  the  literature  we  have 
found,  although  people  are  starting  to  pose  them  in  one  way  or  an¬ 
other.  The  teaching  of  problem  solving  skills  would  best  be  described 
as  interesting  but  unvalidated. 


1.4  STRUCTURES  OF  PROBLEMS 

One  major  difficulty  is  that  we  do  not  see  "general"  problems.  All 
problems  we  are  presented  with  are  domain  specific.  We  spend  most 
our  school  years  from  kindergarten  through  graduate  school  learning 
problem  solving  techniques  for  particular  areas.  It  becomes  difficult  to 
see  the  forest  for  the  trees.  There  are  several  ways  that  the  struc¬ 
turing  of  problems  can  be  approached.  One  way  was  the  technique 
used  early  in  the  history  of  artificial  intelligence.  This  was  to  assume 
that  there  were  general  techniques  for  solving  problems  and  then  try  to 
design  intelligent  programs  that  incorporated  these  techniques  and  turn 
them  loose  on  a  variety  of  domains.  The  best  example  of  this  approach 
is  the  General  Problem  Solver  (GPS)  of  Newell,  Shaw  and  Simon  [Ernst 
and  Newell,  1969].  This  was  not  really  a  unified  computer  program  but 
instead  was  a  loose  alliance  of  concepts  and  programs  that  tried  to 
achieve  general  problem  solving  ability  in  a  variety  of  domains. 
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1.  Understand  the  problem. 

What  is  the  unknown?  What  are  the  data?  What  is  the 
condition?  Draw  a  figure. 

Introduce  suitable  notation.  Separate  various  parts  of  the  condition 

2.  Devise  a  Plan. 

Have  you  seen  the  same  problem  before?  Do  you  know  a 
related  problem?  Consider  auxiliary  problems. 

Go  back  to  definitions. 

3.  Carry  out  Your  Solution  Plan. 

Check  each  step.  Make  sure  each  step  is  correct. 

4.  Evaluate  your  solution. 

Can  you  check  the  result?  Can  you  derive  the  result 
differently?  Can  you  use  the  result  or  the  method  for  some  other 
problem? 


Figure  1:  Polya's  Problem  Solving  Methodology 


In  the  1950's,  computers  made  it  possible  to  test  out  theories  of 
problem  solving.  Allen  Newell  and  Herbert  Simon  began  to  develop 
theories  of  human  problem  solving.  Their  view  was  that  a  good  theory 
of  problem  solving  should  also  be  a  good  problem  solver.  They  used 
computer  simulation  to  test  their  theories.  This  work  was  very  produc¬ 
tive.  It  led  to  advances  in  psychology,  education  and  computer  sci¬ 
ence.  They  worked  on  many  problem  solving  programs  including  a  logic 
theorist,  a  chess  program  and  even  a  general  problem  solving  program. 
This  was  nearly  thirty  years  ago,  and  we  are  still  working  out  the  im¬ 
plications  of  this  work. 


1.3  TEACHING  GENERAL  PROBLEM  SOLVING 

There  has  been  an  increasing  interest  in  incorporating  courses  in 
problem  solving  into  curricula.  General  problem  solving  courses  are 
taught  to  undergraduates  in  the  Department  of  Psychology  at  Carnegie- 
Mellon  University  and  in  the  College  of  Engineering  at  UCLA  [Hayes, 
1981;  Rubenstein,  1980].  These  courses  encourage  students  to  see 
their  skills  in  a  general  context  and  to  learn  how  to  learn.  These 
courses  have  been  in  place  for  several  years.  The  results  have  been 
good  enough  to  continue  them,  however,  there  has  been  no  formal  vali¬ 
dation  of  these  courses. 


2.4.2  Training  through  the  Naval  Civilian  Personnel  Command 


The  Naval  Civilian  Personnel  Command  offers  two  courses  to  senior 
Naval  officers.  They  are  the  Senior  Line  Management  Institute  (5  day 
course),  and  the  Prospective  Commanding  Officer  Shore  Station  Manage¬ 
ment  Training  Program  (three  week  course).  The  former  course  em¬ 
phasizes  civilian  personnel  issues  and  the  latter  focuses  on  the  manage¬ 
ment  issues  involving  a  typical  shore  command. 


2.5  PROBLEMS  ENCOUNTERED  DURING  A  NAVAL  OFFICER'S  CAREER 

Problems  associated  with  officer  management  effectiveness  have  been 
observed  [Rezin,  1976].  The  managerial  problems  are  perceived  to  be 
due  to  the  lack  of  formal  managerial  training,  short  tours  of  duty,  and 
short  Naval  careers  [Shepherd,  1974,  Rezin,  1976;  Vandover,  1981]. 
However,  the  conventional  principles  of  management  as  they  apply  to 
the  private  sector  or  governmental  agencies  do  not  strictly  apply  to 
the  Naval  officer  performing  administrative  and  management  duties. 
The  fact  still  remains  that  the  Navy  is  a  military  organization  and  the 
nature  of  an  "officer's  job"  is  defined  within  its  structure.  That  is, 
the  officer  is  skilled  within  a  warfare  specialty  or  specialization  and  at 
the  same  time  functions  as  a  general  manager.  In  the  private  sector 
and  other  governmental  agencies  people  usually  function  in  the  single 
role  of  manager.  In  general.  Naval  officers  are  technically  prepared  to 
solve  problems  encountered  in  their  specialties.  Managerial  skills,  how¬ 
ever,  must  be  learned  informally  from  the  administrative  responsibilities 
associated  with  duty  assignments. 


A  MODEL  OF  THE  PROBLEM  SOLVING  PROCESS 


Before  one  can  teach  problem  solving,  one  must  have  a  definition  of 
a  problem.  A  good  choice  is; 

A  person  is  confronted  with  a  problem  when  he  wants  some¬ 
thing  and  does  not  know  immediately  what  series  of  actions 
he  can  perform  to  get  it.  ^ 

The  problem  may  be  of  any  type,  mathematical,  social,  managerial  or 
whatever.  The  main  feature  is  dissonance  between  the  initial  state  and 
the '  goal  state.  Presumably  the  problem  solver  has  some  means  to 
translate  the  initial  state  to  the  goal  state,  although  the  transformations 
to  be  used  may  not  always  be  obvious. 

Next,  one  must  have  a  model  of  the  problem  solving  process.  There 
are  many  ways  to  do  this.  We  will  use  the  model  shown  in  Figure  6 
based  on  that  of  Newell  and  Simon  to  represent  the  process.  This  is  a 
general  model  of  a  solution  process.  It  is  similar  to  the  design  process 
in  systems  analysis  and  software  engineering.  This  should  be  no  sur¬ 
prise  since  these  disciplines  are  simply  formal,  structured  problem  solv¬ 
ing  methodologies.  It  should  be  recognized  that  this  process  is  not  a 
rigid,  linear  march  toward  a  solution.  At  any  point  in  the  process,  it 
is  possible  to  backtrack  and  try  another  approach.  Novice  problem  sol¬ 
vers  frequently  fail  to  realize  this  when  they  try  to  solve  problems. 
Giving  up  too  soon  is  one  thing  which  distinguishes  poor  problem  sol¬ 
vers  from  good  ones. 


^  Newell  and  Simon,  Human  Problem  Solving,  p.  72. 


1.  Choose  a  representation  for  the  problem. 


2.  Choose  a  method  for  solving  the  problem  from  the  collection  of 

methods  that  work  on  the  representation  chosen. 

3.  During  the  application  of  the  method,  several  things  can 

happen.  They  include: 

a)  The  problem  is  solved. 

b)  The  method  is  inadequate,  and  another  method  must  be 
chosen . 

c)  The  representation  is  inadequate,  and  another  representation 
must  be  chosen. 

d)  The  attempt  to  solve  the  problem  is  partially  sqccessful  and  a 
new  subproblem  is  generated. 

e)  The  attempt  to  solve  the  problem  is  abandoned. 

4.  During  the  solution  attempt,  subgoals  are  likely  to  be 

generated.  These  can  be  put  aside  for  later  work  applying  the 
same  general  problem  solving  format  as  before. 

Figure  6:  A  Model  of  the  Problem  Solving  Process 


Any  representation  of  a  problem  will  be  made  up  of  several  parts. 
They  include: 

1.  A  set  of  objects. 

2.  A  set  of  operators  that  transform  objects  in  the  problem  space 

into  other  objects. 

3.  An  initial  state. 

4.  A  goal  state. 

In  school  problems,  we  are  given  all  parts  of  the  representation.  We 
have  the  objects,  operators,  initial  state  and  goal  state.  The  learning 
objective  is  acquire  a  strategy  for  applying  the  operators.  Even  there, 
we  are  usually  limited.  Intentionally  or  not,  most  students  learn  that 
the  way  to  solve  the  problem  is  to  reproduce  the  "correct"  solution 


methods  in  the  book.  It  is  small  wonder  that  most  people  are  not 
terribly  creative  at  problem  solving. 

The  choice  of  a  representation  can  mean  several  things.  First,  it  is 
the  choice  of  problem.  Our  definition  at  the  beginning  of  the  section 
defined  a  problem  as  dissonance  between  the  current  state  and  the  de¬ 
sired  state.  Finding  a  solution  means  reducing  this  dissonance.  But, 
there  may  be  more  than  one  way  to  reduce  this  dissonance.  The 
problem  solver  will  not  necessarily  find  the  correct  ways  to  reduce  it. 
This  is  the  problem  finding  process,  and  it  is  part  of  the  process  of 
choosing  a  good  representation. 

For  example,  suppose  that  a  company  is  losing  money.  There  may 
be  many  reasons  for  this.  It  could  be: 

1.  A  production  problem. 

Production  costs  are  too  high;  new  equipment  is  needed. 

Inventory  costs  are  too  high;  production  schedules  are  bad. 

Shipping  costs  are  too  high;  a  new  routing  scheme  is  needed. 

2.  A  marketing  problem. 

Producing  the  wrong  product  for  the  market. 

Targeting  the  wrong  market. 

Pricing  the  product  incorrectly. 

3.  A  financial  problem. 

The  company  has  cash  flow  problems. 

The  capital  structure  needs  revised. 

4.  A  personnel  problem. 

The  company  needs  to  be  reorganized.  Key  workers  ire  un¬ 
derpaid. 

Once  we  have  decided  what  the  problem  is,  we  have  to  choose  a 
representation  to  express  it.  If  the  problem  is  a  production  problem 
where  a  new  routing  and  warehouse  structure  is  needed,  perhaps  a  lin¬ 
ear  program  would  be  a  good  representation.  Maybe  an  integer  vehicle 
routing  algorithm  would  be  more  appropriate.  The  richer  a  repertoire 
of  representations  we  have,  the  better  we  will  do  with  the  problem. 

The  choice  of  representation  is  a  difficult  problem.  A  good  repre¬ 
sentation  limits  search  without  adding  unnecessary  constraints.  It  al¬ 
lows  us  to  look  at  a  problem  in  depth,  discarding  search  paths  that  will 
be  unproductive.  Some  of  the  specific  problems  with  representations 
will  be  discussed  in  the  next  chapter. 
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3.1  PROBLEM  SOLVING  AS  A  PROCESS 


The  choice  of  a  problem  and  a  representation  for  the  problem  con¬ 
verts  an  ill-defined  problem  to  a  well-defined  problem.  With  a  repre¬ 
sentation  in  hand  we  can  begin  applying  search  strategies  that  trans¬ 
form  an  initial  state  into  intermediate  states  and  finally  to  our  goal.  If 
we  are  lucky,  we  may  have  an  optimization  problem.  For  optimization, 
we  know  that  a  solution  exists  that  is  better  than  or  equal  to  all  other 
possible  solutions.  If  we  are  even  luckier,  we  may  have  an  algorithm 
that  can  discover  this  solution  with  a  reasonable  amount  of  effort. 

More  likely,  however  is  the  case  where  optimization  is  not  possible. 
It  may  be  possible,  but  we  do  not  know  how  to  do  it  or  cannot  do  with 
reasonable  effort.  This  is  the  case  with  many  problems  that  generate 
computationally  intractable  integer  programs  (e.g.  assembly  line  balanc¬ 
ing  problems).  Then,  we  have  to  fall  back  on  heuristics  -  that  is  rules 
of  thumb.  A  heuristic  generates  good  solutions  with  ,a  reasonable 
amount  of  effort.  It  does  not  guarantee  optimality.  Consider  chess  as 
an  example.  It  is  possible  to  have  a  computer  start  with  an  initial 
chess  position  and  generate  end  games.  Then,  all  we  have  to  do  is 
pick  the  sequence  of  moves  that  guarantees  us  the  best  final  position 
no  matter  what  our  opponent  may  do.  This  is  the  essential  idea  behind 
game  theory  and  is  called  a  "minimax"  strategy. 

This  is  not  much  help  for  solving  real  chess  problems.  It  has  been 
estimated  that  there  are  10^*®  different  endings  to  the  game  tree  for 
chess.  This  is  a  big  number,  and  we  need  to  give  it  a  little  perspec¬ 
tive.  It  has  also  been  estimated  that  there  are  10^*  elementary  parti¬ 
cles  in  the  universe.  This  means  that  there  are  41  orders  of  magnitude 
more  endgame  situations  in  chess  than  there  are  elementary  particles  in 
the  universe.  Suppose  then  that  every  elementary  particle  in  the  uni¬ 
verse  were  a  computer  grinding  out  chess  solutions  at  the  rate  of  one 
per  nanosecond  (much  faster  than  any  conceivable  computer  could  do 
it).  Then,  it  would  take  10“*  nanoseconds  or  about  3.2  x  10*“  years 
to  compute  all  chess  endgames.  Since  the  universe  is  about  2  x  10*° 
years  old,  this  is  roughly  160  trillion  times  the  age  of  the  universe. 
Computational  problems  of  this  magnitude  are  remote  even  if  we  could 
convince  every  elementary  particle  to  be  a  computer. 

Obviously,  a  strategy  to  limit  search  effort  is  needed.  This  is 
where  heuristics  come  in.  A  heuristic  is  a  rule  to  limit  search  in  prob¬ 
lem  solving.  In  chess,  there  are  many  such  rules.  One  example  might 
be  to  protect  your  queen.  This  is  the  most  powerful  piece  on  the 
board,  and  you  are  in  trouble  if  you  lose  it.  On  the  other  hand, 
blindly  following  this  rule  can  cause  one  to  overlook  queen  sacrifice 
strategies  that  could  lead  to  a  win. 


There  are  many  heuristics  in  general  problem  solving.  Examples  of 
search  strategies  include: 

1.  Trial  and  error  -  try  all  possible  options  without  selection 

rules. 

2.  Depth  first  -  search  deeply  along  one  search  path. 

3.  Breadth  first  -  search  all  the  moves  at  one  level  before  moving 
to  the  next  level. 

4.  Segmentation  -  break  a  problem  up  into  subproblems. 

5.  Hill  climbing  -  make  small  moves  in  directions  around  your  pres¬ 

ent  position.  Then  move  in  the  direction  that  yields  the  great¬ 
est  improvement  and  start  over. 

6.  Working  backwards  -  assume  you  are  at  the  solution  and  then 

reconstruct  the  moves  you  would  have  to  have  made  to  get 
there. 

7.  Analogy  -  compare  this  problem  to  an  existing  problem  for  which 

you  already  have  a  solution. 

These  problem  solving  methods  can  be  regarded  as  a  bag  of  tricks. 
No  one  problem  solving  method  uses  just  a  single  heuristic.  A  good 
general  problem  solver  would  apply  one  or  another  where  appropriate. 
As  an  example,  consider  chess  again.  The  best  approach  might  be  to 
start  with  a  breadth  first  search  to  identify  likely  candidate  paths.  A 
breadth  first  search  is  limited  because  of  the  many  possibilities.  After 
suitable  candidates  have  been  identified,  the  depth  first  techniques  can 
be  used.  Analogy  could  be  used  to  compare  the  current  game  situation 
with  past  games.  Besides  these  general  heuristics,  special  purpose 
heuristics  could  also  be  used. 

The  ideas  behind  general  purpose  heuristics  are  not  difficult  to  un¬ 
derstand.  But,  people  seem  to  have  trouble  in  applying  the  ideas. 
Research  shows  little  transfer  from  the  general  techniques  to  specific 
problem  domains.  There  may  be  many  reasons  for  this.  One  may  be 
insufficient  practice  in  applying  general  as  opposed  to  domain  specific 
techniques . 


PROBLEM  DOMAINS  AND  THE  ROLE  OF  MODELS 


There  are  many  problems  when  one  tries  to  address  problem  solv¬ 
ing  in  general.  Problems  present  themselves  in  specific  formats.  Per¬ 
haps  our  education  is  responsible.  Problems  are  always  presented  in 
the  context  of  a  course  studying  specific  methods  of  solution.  The  fo¬ 
cus  is  to  learn  the  methods  and  get  the  answer  in  the  book.  Problem 
solving  becomes  a  matter  of  acquiring  specific  techniques  and  replaying 
the  appropriate  script  when  the  right  problem  comes  along. 

This  type  of  education  may  be  necessary  for  people  to  learn  gener¬ 
ally  accepted  methods  of  solving  problems.  But,  it  does  not  offer  much 
guidance  about  what  to  do  when  faced  with  new  kinds  of  problems.  It 
is  possible  to  go  through  formal  education  all  the  way  to  the  doctoral 
level  without  ever  considering  how  one  actually  solves  problems.  The 
process  of  solving  problems  has  to  be  learned  by  example.  The  knowl¬ 
edge  and  methods  picked  up  in  courses  forms  a  paradigm  for  a  new 
generation  of  problem  solvers  to  follow.  There  is  seldom  any  attempt  to 
generalize  the  methods  learned  in  one  area  and  transfer  them  to  other 
areas . 

A  good  example  of  this  is  calculus.  Most  of  us  remember  the  stan¬ 
dard  Freshman  calculus  sequence.  The  examples  presented  in  the  book 
exhibited  a  linear  progression  from  initial  assumptions  to  final  solution. 
It  was  intimidating  to  find  that  one’s  own  work  toward  a  solution  was 
seldom  so  clean  or  logical.  It  usually  contained  many  false  starts, 
backtracking  and  missed  assumptions.  If  we  were  good  at  calculus,  we 
could  eventually  approximate  the  solution  methods  in  the  book.  If  we 
were  not,  calculus  rapidly  became  a  traumatic  experience.  We  felt  that 
real  mathematicians  were  those  who  could  write  the  type  of  problem 
solving  sequences  illustrated  in  the  text. 

This  is  not  necessarily  true.  If  one  were  to  go  back  to  Newton’s 
original  work  on  the  calculus,  one  would  find  that  it  was  as  full  of  false 
starts  and  strange  assumptions  as  any  other  beginner’s  work.  It  is 
unlikely  that  even  a  professional  mathematician  today  could  read  it  and 
understand  it.  It  was  couched  in  terms  acceptable  to  a  limited  number 
of  seventeenth  century  mathematicians  who  were  proficient  in  geometry. 
It  is  almost  unreadable  today.  It  was  almost  another  century  before  the 


Bernoulli  brothe'  were  able  to  put  it  into  a  form  that  could  be  widely 
applied . 

This  IS  especially  noticeable  in  mathematics,  but  the  same  comments 
could  be  applied  to  any  other  branch  of  knowledge.  Teaching  was  and 
is  largely  concerned  with  examples  of  solution  techniques  and  transmis¬ 
sion  of  knowledge.  Very  little  of  it  focuses  on  the  specific  methods  (if 
any)  by  which  solutions  are  reached  and  new  knowledge  may  be  added. 


4.1  EXAMPLES  OF  PROBLEMS 


To  illustrate  some  points  about  the  structure  of  problems  represen¬ 
tations  and  problem  domains  let  us  consider  some  different  problems. 
These  are  presented  in  no  particular  order. 


1 . 


Fill  in  the  digits  represented  by  the  letters  in  the  sum  given 
below: 

SEND 
+  MORE 


MONEY 

This  is  the  type  of  cryptarithmetic  problem  that  delights  puzzle 
fans.  Solving  this  one  requires  changing  representation  (sub¬ 
stituting  digits  for  the  letters)  using  a  trial  and  error  process 
aided  by  a  few  heuristics  (example  -  the  letter  M  must  repre¬ 
sent  1).  This  example  involves  much  backtracking  and  testing 
of  assumptions. 

2.  Suppose  that  you  were  to  meet  a  friend  in  New  York  City.  You 
knew  the  date  on  which  you  were  to  meet  but  that  was  all. 
Your  friend  knew  the  same.  You  cannot  communicate  with  each 
other  to  settle  on  a  time  and  place.  Choose  a  time  and  a  place 
to  meet  your  friend. 

It  is  obvious  that  this  problem  cannot  have  a  "right"  answer  in 
the  sense  that  a  math  problem  can.  But  for  large  numbers  of 
people  (mostly  those  familiar  with  New  York  City),  the  problem 
may  be  solvable.  The  trick  is  to  assume  that  the  other  person 
will  choose  an  obvious  place  and  time  and  then  try  to  do  the 
same  yourself.  It  is  an  example  of  the  way  specialized  knowl¬ 
edge  is  used  in  problem  solving.  The  most  common  choice  for 
New  Yorkers  is  under  the  clock  at  Grand  Central  Station  at 
noon.  Non-natives  do  not  do  nearly  so  well  on  this  one. 
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Give  the  next  digit  in  the  sequences: 

1,2, 3, 4,5,  ... 

1,4,9,16,25,  ... 

1,2,3,5,7,11,  ... 

14,18,23,28,34,42,... 

This  problem  is  like  many  other  problems  in  mathematics.  The 
idea  is  to  find  the  underlying  pattern  and  then  use  induction 
to  work  things  out.  The  trick  is  to  recognize  patterns,  and 
test  hypotheses  about  how  those  patterns  are  formed.  The 
first  sequence  is  simple  counting,  the  second  is  the  squares  of 
the  integers,  and  the  thi''d  is  the  sequence  of  primes.  All 
these  nice  logical  sequences  leave  the  problem  solver  unpre¬ 
pared  for  the  fourth  sequence.  The  next  number  in  the  se¬ 
quence  is  50,  but  the  subject  would  be  unlikely  to  get  this 
without  specialized  knowledge.  This  is  a  sequence  of  subway 
stops  on  the  IRT  in  Manhattan. 

Solve  the  following  for  X: 

X  =  2*SQRT(2*SQRT(2*SQRT(  ...  ))) 

This  problem  is  an  example  of  how  representation  can  help. 

This  problem  looks  almost  impossible  expressed  in  functional 

notation  or  in  radical  notation.  If  it  is  translated  to  exponen¬ 
tial  notation,  it  becomes  trivial. 

Suppose  you  had  six  toothpicks.  Construct  four  equilateral  tri¬ 
angles  each  of  whose  sides  is  one  toothpick  long  out  of  the  six 
toothpicks. 

This  problem  offers  an  example  of  ways  in  which  subjects  can 

block  themselves  by  adding  constraints  that  are  not  there.  To 

solve  it,  just  construct  a  tetrahedron.  That  only  requires  six 
toothpicks  and  each  face  is  an  equilateral  triangle.  The  prob¬ 
lem  for  most  people  is  that  they  add  the  unstated  constraint 
that  the  figure  must  be  two  dimensional. 

You  have  been  challenged  to  a  game  of  Number  Scrabble.  You 
and  your  opponent  have  nine  tokens  in  a  pile  between  you. 
The  tokens  are  numbered  1  through  9.  You  take  turns  draw¬ 
ing  tokens  from  the  pile.  The  first  person  to  have  three  to¬ 
kens  (drawn  in  any  order)  whose  sum  is  15  wins.  Devise  a 
strategy  for  this  game. 


The  interesting  thing  about  number  scrabble  is  that  you  have 
already  devised  a  strategy  for  playing  it.  Suppose  you  ar¬ 
ranged  the  numbers  like  this: 


6 

1 

8 

7 

5 

3 

2 

9 

4 

This  figure  is  called  a  "Magic  Square".  The  mag^c  is  that  the 
numbers  in  the  rows,  columns  and  diagonals  all  sum  to  15. 
This  is  exactly  the  requirement  for  a  win  in  Number  Scrabble. 
With  this  change  in  representation,  Number  Scrabble  should 
look  familiar.  It  is  an  isomorph  for  Tic-Tac-Toe  and  the  same 
strategies  that  work  for  one  will  work  for  the  other. 

7.  Suppose  you  were  General  Eisenhower  trying  to  decide  how  to 
choose  a  date  for  0-Day.  How  would  you  go  about  solving  this 
problem? 

This  is  the  classical  unstructured,  large,  messy  management 
problem.  There  is  no  particular  method  that  will  work.  It  is 
more  a  problem  of  defining  the  goal,  breaking  that  definition 
down  into  subgoals,  looking  at  constraints,  modifying  goals  and 
so  on.  The  paradigm  developed  by  Newell  and  Simon  works 

here  too.  It  is  just  much  more  involved.  The  major  problem 
(for  General  Eisenhower  at  least)  was  to  structure  the  problem 
select  the  goals  (by  no  means  as  clear  then  as  now).  He  could 
let  his  staff  work  out  the  details  while  he  monitored  the  prog¬ 
ress  . 

One  could  go  on  with  example  problems  forever.  Sometimes  this 

seems  to  be  the  approach  of  books  on  problem  solving.  The  problems 
above  are  from  a  variety  of  areas.  They  are  not  necessarily  "fair"  in 
the  sense  that  they  follow  well  defined  rules.  They  are  not  necessarily 
well  structured.  They  do  illustrate  some  good  points  about  the  problem 

solving  process  that  reinforce  the  choice  of  a  problem  solving  model 

made  in  Chapter  4. 
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First,  there  is  the  importance  of  choice  of  representation.  This  is 
shown  in  the  square  root  problem,  the  six  triangles  problem,  and  the 
Number  Scrabble  problem.  The  wrong  choice  of  representation  can 
render  even  simple  problems  unsolvable.  The  right  choice  of  represen¬ 
tation  can  make  a  problem  disappear.  Deciding  on  what  is  the  right  or 
wrong  representation  is  no  easy  matter.  It  seems  clear  that  some  rep¬ 
resentations  dominate  others  (e.g.  Arabic  numerals  as  compared  to  Ro¬ 
man  numerals).  It  is  not  clear  how  to  set  up  criteria  for  comparing 
representations.  One  characteristic  of  gifted  problem  solvers  is  their 
ability  to  change  representations.  One  example  was  Albert  Einstein  who 
used  many  unusual  problem  representations  in  deriving  and  explaining 
his  theories. 

A  second  point  illustrated  is  the  importance  of  knowledge  in  many 
problem  solving  situations.  The  problem  about  where  to  meet  in  New 
York,  the  last  "complete  the  sequence"  problem  and  Eisenhower's  prob¬ 
lem  on  D-Day  all  involve  specialized  knowledge.  It  would  )3e  convenient 
for  education  if  specialized  knowledge  of  real  problem  domains  were  not 
necessary,  but  this  seems  increasingly  unlikely. 

A  final  point  illustrated  by  the  last  problem  is  the  importance  of 
problem  finding.  It  was  not  obvious  that  the  European  invasion  should 
take  place  in  Normandy  in  the  Spring  of  1944.  The  Americans  initially 
pushed  for  1943.  The  Russians  were  pushing  for  a  second  front  as 
early  as  possible.  Churchill  at  times  wanted  to  go  for  the  "soft  under¬ 
belly”  of  Europe  by  invading  hrough  Southern  France  or  Sicily  (per¬ 
haps  he  wanted  to  redeem  the  disaster  at  Gallipoli  thirty  years  earlier). 
The  initial  problem  here  was  to  define  the  problem. 

It  seems  that  education  concentrates  mostly  on  the  importance  of 
knowledge.  Choosing  new  representations  or  using  problem  finding 
skills  is  actively  discouraged.  If  people  are  allowed  to  play  with  the 
representation  of  a  problem,  they  might  not  learn  the  methods  in  the 
book.  In  general,  this  may  not  be  bad.  But  it  can  discourage  cre¬ 
ativity  in  the  gifted  minority.  The  same  is  true  of  problem  finding. 
All  through  the  educational  process,  problems  are  given.  Little  attempt 
is  made  to  break  out  and  encourage  students  to  find  and  define  their 
own  problem.  If  we  are  interested  in  teaching  problem  solving,  these 
are  issues  that  must  be  faced.  By  the  graduate  level,  it  may  be  too 
late  to  do  this. 
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4.2  CLASSIFYING  PROBLEM  DOMAINS 

Classifying  problems  into  categories  offers  many  possibilities  for 
trouble.  Any  classification  scheme  is  likely  to  be  limited  by  the  bias  of 
the  individual  setting  up  the  scheme.  The  present  authors  are  no  ex¬ 
ception  to  this. 

As  a  starter,  we  would  propose  classifying  problems  as  either  well 
defined  or  ill  defined.  A  well  defined  problem  can  be  defined  as: 

A  problem  proposed  to  an  information  processing  system  is 
"well  defined"  if  a  test  exists,  performable  by  the  system 
that  will  determine  whether  an  object  proposed  as  a  solution 
is  in  fact  a  solution . " 

This  definition  of  a  well  defined  problem  fits  most  of  the  mathematical 
and  logic  problems  commonly  found  in  books.  Many  mariiagerial  prob¬ 
lems,  on  the  other  hand  would  have  to  be  classified  as  ill  defined.  The 
"information  processing  system"  referred  to  in  the  quote  is  completely 
general.  It  could  be  either  a  man  or  a  machine.  For  a  problem  to  be 
well  defined,  we  must  have  done  the  initial  work  of  problem  finding  and 
selection  of  a  representation.  If  not,  no  test  can  exist  because  we  do 
not  know  what  we  are  testing. 

If  no  representation  of  the  problem  exists,  then  we  have  an  ill  de¬ 
fined  problem.  Our  first  task  is  to  decide  what  the  problem  is.  Then 
we  can  create  a  representation  for  it.  This  situation  characterizes 
many  of  the  management  problems  that  a  Naval  officer  (or  any  other 
manager)  will  face.  In  one  sense,  all  problems  could  be  considered  well 
defined.  If  a  problem  is  dissonance  between  the  current  state  and  a 
goal  state,  then  any  action  that  causes  the  dissonance  to  disappear  is  a 
solution . 

As  an  example,  consider  a  manager  whose  company  is  not  profitable. 
He  could  view  this  problem  in  a  variety  of  ways.  Perhaps  it  is  a  mar¬ 
keting  problem.  The  company  has  targeted  the  wrong  market  or  is  us¬ 
ing  the  wrong  advertising  strategy.  Maybe  he  could  view  it  as  a  pro¬ 
duction  problem.  Production  costs  are  out  of  control  and  need  to  be 
brought  back  in  line.  Perhaps  it  is  a  personnel  problem.  Poor  em¬ 
ployee  morale  is  hurting  productivity.  Or  perhaps  it  is  not  a  problem 
at  all.  Maybe  the  manager  views  it  as  a  startup  phenomenon  that  will 
go  away  as  the  product  line  matures.  The  choice  of  representation  and 
definition  of  the  problem  will  determine  what  is  done  about  it. 


*  Allen  Newell  and  Herbert  Simon,  Human  Problem  Solving,  p.  73. 
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Once  a  problem  has  been  defined  and  a  representation  chosen  for  it, 
then  it  becomes  a  well  defined  problem.  Then,  we  have  a  series  of 
steps  (operators)  that  we  can  use  for  solving  the  problem,  and  a  cri¬ 
terion  for  stopping  our  search.  Most  disciplines  concentrate  on  this 
part  of  the  problem  solving  process.  This  is  not  surprising.  They  are 
trying  to  teach  problem  solving  within  the  framework  of  a  discipline. 

One  way  to  represent  problems  would  be  as  a  task  environment.  In 
this  approach,  we  partially  follow  Newell  and  Simon®.  A  task  environ¬ 
ment  can  be  looked  at  in  a  variety  of  ways.  They  are; 

1.  A  set  representation  of  a  problem. 

Given  a  set  U,  find  a  member  of  set  U  having  specified  prop¬ 
erties  (our  goal) . 

2.  A  search  representation  of  a  problem.  , 

Given  an  initial  state,  a  set  of  transformations  and  a  goal 
state,  move  from  the  initial  state  to  the  goal  state. 

3.  A  design  representation  of  a  problem. 

Given  a  problem  situation,  define  the  problem  and  create  a 
representation  for  it. 

An  example  of  the  set  problem  might  be  to  find  the  combination  of  a 
safe.  The  set  of  possible  solutions  is  known  but  large  and  the  problem 
is  to  search  that  space.  An  example  of  the  second  type  of  problem  is 
the  proof  of  a  mathematical  theorem.  We  begin  with  a  set  of  initial  con¬ 
ditions,  we  have  a  series  of  transformations,  and  we  wish  to  arrive  at 
our  goal  (the  theorem)  by  applying  these  transformations.  The  imple¬ 
mentation  of  the  decision  to  invade  Europe  during  World  War  II  is  an 
example  of  the  last  type  of  problem.  So  would  the  decision  to  set  up  a 
mass  transit  system  for  a  city  or  region. 

These  three  definitions  of  a  task  environment  are  not  mutually  ex¬ 
clusive.  All  three  of  them  could  be  used  in  resolving  a  problem  situ¬ 
ation  as  might  be  the  case  in  an  engineering  design  problem.  Most  of 
our  schooling  revolves  around  the  first  two  task  environments.  The 
real  world  is  the  last  type. 


®  Allen  Newell  and  Herbert  Simon,  Human  Problem  Solving,  pp.  12-11 . 
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4.3  MODELS  AS  REPRESENTATIONS  OF  DOMAINS 


When  we  find  ourselves  faced  with  a  problem  situation,  we  have  to 
have  some  way  of  understanding  it.  For  this,  we  typically  use  models 
of  some  kind.  In  this  context,  a  model  is  a  mental  structure  that  can 
be  used  to  test  hypotheses  and  behavior  of  a  real  world  system.  A 
map  would  be  an  example  of  a  model.  It  is  an  abstracted  representation 
of  real  world  features  we  are  interested  in.  Maps  will  differ  greatly  in 
the  features  they  show  depending  on  the  use  we  wish  to  make  of  the 
map.  For  instance,  if  we  are  hiking,  our  best  choice  is  a  contour  map 
of  the  area.  If  we  are  flying  a  plane  on  instrvments,  we  need  a  map 
showing  names  and  frequencies  of  navigational  aids  and  minimum  safe 
altitudes  on  route.  Terrain  features  are  irrelevant  in  this  kind  of  mod¬ 
el  . 

A  full  discussion  of  modeling  in  problem  solving  would  be  philosoph¬ 
ically  involved,  lengthy  and  beyond  the  scope  of  this  report.  Modeling 
is  more  of  an  art  than  a  science.  It  is  nothing  more  than  the  choice  of 
representations  for  task  environments.  A  good  model  should: 

1  .  Display  the  state  of  the  system  before  and  after  transforma¬ 
tions. 

2.  Be  capable  of  being  manipulated. 

3.  Be  capable  of  predicting  system  behavior. 

4.  Provide  an  adequate  representation  of  all  features  of  interest  in 

the  system. 

An  example  of  a  model  would  be  the  use  of  Euclidean  Geometry  to  rep¬ 
resent  limited  portions  of  the  surface  of  the  earth.  This  fits  points  1 
through  3  for  a  good  model.  If  we  are  only  interested  in  limited  sur¬ 
faces,  then  it  fits  point  4  as  well.  Newtonian  mechanics  in  physics  is 
another  model  example.  It  fits  points  1  and  2.  For  phenomena  where 
relative  velocities  are  low,  it  also  does  well  on  points  3  and  4.  But,  if 
we  are  talking  about  high  relative  velocities,  it  breaks  down  completely. 


4.3.1  The  Role  of  Assumptions  in  Modeling 

Assumptions  are  constraints  that  allow  us  to  bound  a  problem.  The 
assumptions  we  make  limit  the  solution  search  process.  Reitman  [1965] 
suggested  that  the  process  of  problem  solving  is  frequently  the  process 
of  successively  adding  constraints  to  the  problem  state.  Each  con¬ 
straint  cuts  away  pieces  of  the  solution  set  and  reduces  search. 
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The  model  is  mostly  a  theoretical  construct  based  on  a  synthesis  of 
research  done  by  many  psychologists.  The  approach  used  in  testing 
many  of  their  theories  included  computer  simulation.  It  is  possible  to 
implement  this  model  on  a  computer  and  let  the  computer  help  work  out 
the  implications  of  the  theory.  This  work  has  had  at  least  as  much  im¬ 
pact  on  computer  science  as  it  has  on  psychology. 

The  educational  implications  of  the  Newell-Simon  model  are  less 
clear.  It  is  a  descriptive  not  a  normative  model.  The  obvious  parts  of 
the  model  to  focus  on  in  improving  general  problem  solving  ability  are 
the  Processor  and  LTM  components.  The  difference  between  good 
problem  solvers  and  poor  ones  is  probably  in  the  processing  rules  they 
use  for  information.  If  good  processing  rules  can  be  discovered  and 
taught  then  there  may  be  real  utility  to  teaching  general  problem  solv¬ 
ing.  The  LTM  component  could  be  improved  by  teaching  improved  re¬ 
call  and  structuring  of  knowledge.  All  this  is  easier  to  do  with  ma¬ 
chines  than  people.  Perhaps  this  is  why  this  theory  has  had  more 
impact  on  computer  science  than  on  education. 
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5.4  HUMANS  AS  PROBLEM  SOLVERS 


The  most  comprehensive  theory  of  human  problem  solving  behavior 
is  that  of  Newell  and  Simon.  They  worked  this  theory  out  over  many 
years.  The  most  complete  explanation  of  the  theory  and  its  justification 
and  sources  is  found  in  their  book  Human  Problem  Solving.  Theirs  is 
an  information  processing  view  of  the  psychology  of  problem  solving. 
The  model  is  computer-like  in  its  assumptions  about  humans. 

The  basic  components  of  the  model  are: 


1 . 

Receptors  and  Effectors 

2. 

Processor 

3. 

Short  Term  Memory 

(STM) 

4. 

Long  Term  Memory 

(LTM) 

5. 

External  Memory 

Data  about  the  environment  is  gathered  by  the  receptors.  It  is  held  in 
STM  and  is  immediately  available  for  processing.  Experimental  evidence 
[Miller,  1956]  indicates  that  the  STM  is  limited  in  its  capacity.  The 
STM  corresponds  to  temporary  buffers  in  computing.  More  recent  psy¬ 
chological  research  has  also  suggested  the  existence  of  an  Intermediate 
Term  Memory  (ITM).  This  memory  controls  our  daily  lives  holding  our 
memory  of  things  like  our  daily  schedule,  appointments,  and  so  on. 
This  would  correspond  to  the  core  memory  in  a  computer  system  if  it 
exists.  Beyond  this,  there  is  the  long  term  memory.  The  LTM  pre¬ 
sumably  is  large  enough  to  store  the  memories  of  a  lifetime.  In  a  com¬ 
puter  system,  the  analogy  is  the  on-line  mass  storage.  The  EM  is 
whatever  memory  aids  we  choose  to  use  (e.g.  paper  notes).  The  com¬ 
puter  analogy  might  be  off-line  archival  storage. 

The  processor  corresponds  to  the  CPU  plus  program  in  a  computer. 
It  seems  to  operate  as  a  serial  processor  although  this  is  hard  to  define 
exactly.  It  is  obvious  that  there  is  a  limited  degree  of  parallelism  in 
neurological  processes,  but  the  basic  control  seems  to  be  serial.  Pro¬ 
cessing  seems  to  have  an  internal  clock  time  of  about  40  milliseconds 
between  elementary  operations  (about  250  operations  per  second).  The 
comparable  rate  for  computers  is  between  10,000  and  100,000  times  fast¬ 
er.  The  basic  operation  is  a  simple  store  and  compare.  The  decision 
making  process  seems  to  behave  like  a  production  rule  system.  Inter¬ 
estingly  enough,  this  production  rule  approach  is  the  same  one  used  in 
the  "Fifth  Generation"  for  implementing  expert  systems  in  computers 
[Clocksin  and  Mellish,  1981]. 


I.  Challenge 

A.  Goal.  Is  there  a  clear  goal  in  the  activity?  Does  the 
interface  provide  performance  feedback  about  how  close 
the  user  is  to  achieving  his  goal? 

B.  Uncertain  outcome.  Is  the  outcome  of  reaching  the  goal 
uncertain? 

1.  Does  the  activity  have  a  variable  difficulty  level? 

For  example,  does  the  interface  have  successive 
layers  of  complexity? 

2.  Does  the  activity  have  multiple  level  goals?  For 

example,  does  the  interface  include  scorekeeping? 

II.  Fantasy 

A.  Does  the  interface  embody  emotionally  appealing 
fantasies? 

B.  Does  the  interface  embody  metaphors  with  physical  or 
other  systems  that  the  user  already  understands? 

III.  Curiosity 

A.  Does  the  activity  provide  an  optimal  level  of 
informational  complexity? 

1.  Does  the  interface  use  audio  and  visual  effects: 

(a)  as  decoration,  (b)  to  enhance  fantasy  and 
(c)  as  a  representation  system? 

2.  Does  the  interface  use  randomness  in  a  way  that  adds 

variety  without  making  tools  unreliable? 

3.  Does  the  interface  use  humor  appropriately? 

B.  Does  the  interface  capitalize  on  t**®  users'  desire  to 
have  "well-formed"  knowledge  structures?  Does  it 
introduce  new  information  when  users  see  that  their 
existing  knowledge  is  (1)  incomplete,  (2)  inconsistent 
or  (3)  unparsimonious? 


Figure  12:  Interface  Design  Heuristics  -  Malone  [1981] 


so  intriguing  and  whether  these  features  of  the  game  interface  could  be 
transferred  to  other  programs.  He  ran  subjects  through  a  series  of 
learning  game  experiments  and  tried  to  abstract  features  of  the  game 
that  worked  best.  From  this,  he  developed  a  set  of  heuristics  for  de¬ 
signing  enjoyable  interfaces.  These  are  given  in  Figure  12. 

This  work  with  exploratory  environments  is  trying  to  find  out  how 
people  solve  problems  in  a  system  where  there  are  few  formal  clues  to 
proper  behavior.  This  has  always  been  a  feature  of  computer  systems. 
The  manual  never  tells  you  everything  there  is  to  know  about  a  system. 
It  simply  cannot.  The  combinatorics  render  that  impossible.  It  has  al¬ 
ways  been  true  that  some  people  are  inherently  better  explorers  of  this 
computer  environment  than  others.  But  until  recently,  there  has  been 
no  research  into  why  this  might  be  so.  Microcomputers  and  video 
games  have  made  this  a  more  pressing  question.  The  video  games  show 
that  exploration  of  complex  environments  is  feasible  and  even  a  reason¬ 
able  thing  to  do.  There  are  few  manuals  to  video  games.  The  wide¬ 
spread  use  of  micros  even  by  non-technical  individuals  makes  a  better 
understanding  of  exploration  necessary. 

The  work  on  exploration  in  the  references  is  interested  primarily  in 
the  interface  design  question.  But,  there  is  a  flip  side  to  this  that  is 
of  interest  in  this  research.  How  can  we  teach  people  to  be  better  ex¬ 
plorers?  Is  this  a  teachable  skill?  This  is  the  same  question  (applied 
to  a  narrower  domain)  that  motivates  this  whole  report.  As  computers 
become  more  pervasive,  this  is  a  question  that  deserves  research. 
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The  problems  noted  by  Carroll  can  be  formidable  obstacles  in  learn¬ 
ing  to  use  a  computer  system.  Some  people  regard  them  as  so  intimi¬ 
dating  that  they  are  never  able  to  master  the  machine.  Others  regard 
them  as  a  challenge  and  even  become  compulsive  about  responding  to  it. 
Carroll  offers  a  series  of  suggestions  for  system  design  to  reduce  the 
problems  noted  in  Figure  10.  These  suggestions  are  given  in  Figure 
11.  Carroll  regards  his  work  as  preliminary.  These  results  were  pub¬ 
lished  in  the  IEEE  Computer ,  and  seemed  generally  interested  in  stimu¬ 
lating  thought  on  software  design  issues. 


Responsiveness  When  you  do  something,  you  get  some 

feedback  (at  least  informational). 

Benchmarks  You  can  tell  where  you  are  within  a 

given  episode  or  session.  Yo^  have  the 
means  for  assessing  achievement  and 
development  of  skill. 

$ 

Acceptable  uncertainty  Being  less  than  fully  confident  of  your 

understanding  and  expertise  is  OK. 

Safe  Conduct  You  cannot  do  anything  too  wrong. 

Learning  by  doing  You  do  so  that  you  can  learn  to  do;;  you 

design  a  plan;  you  do  not  merely  follow 
a  recipe. 

Opportunity  Most  of  the  things  you  learn  to  do  work 

everywhere.  You  can  reason  out  how  to 
do  many  other  things. 

Taking  charge  If  progress  stagnates,  something  new  is 

suggested  or  happens  spontaneously. 

Control  You  are  in  control  or  at  least  have  the 

illusion  of  being  in  control. 

Figure  11:  Exploratory  Environment  Characteristics  -  Carroll [1982a] 


Malone  [1981]  is  studying  the  same  kind  of  issues  as  Carroll.  His 
work  also  focuses  on  the  relationship  between  computer  games  and  more 
conventional  computer  programs.  He  is  interested  in  what  makes  games 


try.  The  quality  of  the  man-machine  interface  can  be  crucial  to  the 
success  of  a  piece  of  software.  In  microcomputing,  some  programs  are 
popular  partly  because  of  their  ease  of  use  (LOTUS  1-2-3  is  a  good  ex¬ 
ample).  Other  programs  that  may  be  equally  powerful  but  unappealing 
to  use  become  commercial  failures. 

Carroll  [1982a]  compares  learning  to  use  a  word  processor  with  the 
fantasy  game  "Adventure".  Both  are  computer  programs.  The  Adven¬ 
ture  program  is  intentionally  confusing,  but  it  draws  users  into  the 
world  it  creates.  In  Carroll's  comparison,  many  word  processors  offer 
the  same  kind  of  confusion  as  Adventure  without  offering  a  balancing 
incentive  to  push  past  the  confusion  and  learn  the  system.  Carroll's 
classification  of  problems  faced  by  these  computer  users  is  given  in 
Figure  10. 


Disorientation  The  user/player  doesn't  know  what  to  do  in  the 

system  environment. 

Illusiveness  What  the  user/player  wants  to  do  is  deflected 

toward  other,  perhaps  undesired,  goals. 

Emptiness  The  screen  is  effectively  vacant  of  hints  as 

to  what  to  do  or  what  went  wrong. 

Mystery  Messages  The  system  provides  feedback  that  is  useless 

and/or  misleading. 

Slipperiness  Doing  the  "same  thing"  in  different 

situations  has  unexpectedly  different 
consequences . 

Side  effects  Taking  an  action  has  consequences  that  are 

unintended  and  invisible  but  cause  trouble 
later. 

Paradox  The  system  tells  the  learner/player  to  do 

something  that  is  clearly  inappropriate. 

Laissez-faire  The  system  provides  no  support  or  guidance 

for  overall  goals  (e.g.  "winning" 

"typing  a  letter") 

Figure  10:  Typical  Problems  Faced  by  Users  -  Carroll[1982a] 
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A  last  paper  is  that  by  Ruth  Pitt  [1983].  It  is  a  comprehensive 
literature  survey  of  the  psychological  literature  on  the  development  of 
general  problem  solving  schema.  The  work  concludes  that  the  develop¬ 
ment  of  a  GPS  schema  takes  place  between  adolescence  and  early  adult¬ 
hood.  She  studied  two  groups  of  students,  one  group  of  tenth  graders 
and  one  group  of  college  students.  She  found  that  the  tenth  graders 
had  limited  ability  to  define  problems  and  generate  hypotheses.  They 
did  not  seem  to  have  a  rich  set  of  problem  representations  or  methods 
for  dealing  with  problems.  The  college  students  were  much  better. 
Their  abilities  approached  that  of  professors  on  most  measures.  The 
findings  here  are  preliminary,  but  there  are  some  interesting  implica¬ 
tions.  Pitt  suggests  that  the  time  to  teach  general  problem  solving 
techniques  is  in  early  adolescence  when  such  concepts  are  being 
formed.  More  mature  students  are  likely  to  respond  better  to  domain 
specific  techniques.  For  better  or  worse,  their  skills  may  already  be 
formed. 

If  these  papers  are  indicative  of  the  general  level  of  interest  in  ed¬ 
ucation  in  teaching  general  problem  solving,  then  the  level  of  interest 
cannot  be  very  high.  It  would  seem  that  the  primary  influence  of  the 
general  problem  solving  work  has  been  to  stimulate  new  approaches  to 
the  teaching  of  conventional  disciplines  as  in  the  Reif  and  Heller  arti¬ 
cle.  There  is  little  work  involving  the  teaching  or  study  of  general 
problem  solving  ability.  It  may  be  that  the  concept  is  too  hard  to  de¬ 
fine  and  that  it  is  safer  to  stay  with  conventional  disciplines.  It  may 
also  be  that  the  best  approach  to  general  problem  solving  techniques  is 
to  integrate  them  in  conventional  areas  to  improve  retention  and  com¬ 
prehension  . 


5.3  EXPLORATION  -  A  STUDY  OF  PROBLEM  SOLVING 

An  interesting  literature  studying  problem  solving  is  growing  in  the 
intersection  between  computer  science,  human  factors  and  psychology. 
This  is  the  study  of  exploration  and  exploratory  environments.  This 
literature  is  represented  in  the  papers  by  Anzai  and  Simon  [1979], 
Carroll,  et.  al.  [1982,  1982a,  1983,  1983a,  1984,  and  1984a],  Darling¬ 
ton,  et.  al.  [1983],  Lewis,  et.  al.  [1982],  Malone  [1981,  1981a,  1981b, 
1981c,  and  1982),  Schrager  and  Klahr  [1983]  and  Winston  [1980].  This 
literature  looks  at  the  way  people  learn  about  an  environment  without 
formal  instruction.  They  must  take  their  clues  from  the  environment, 
form  hypotheses  and  act  on  the  basis  of  these  hypotheses. 

This  study  is  of  interest  to  cognitive  psychologists  because  it  pro¬ 
vides  a  way  to  study  human  problem  solving  behavior  in  a  controllable 
environment.  It  is  of  potentially  greater  payoff  to  the  computer  indus- 
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Success  on  their  tests  correlated  highly  with  IQ.  Girls  were  signif¬ 
icantly  poorer  problem  solvers  than  boys.  The  authors  attributed  this 
to  their  unfamiliarity  with  the  tools  posed  in  the  problems.  A  possible 
alternate  explanation  might  be  that  girls  are  more  strongly  socialized  to 
be  "good".  This  would  tend  to  cause  them  to  ignore  the  rule  breaking 
required  in  these  problems.  The  authors  conclude  that  general  problem 
solving  ability  exists  and  is  highly  correlated  with  conventional  meas¬ 
ures  of  intelligence. 

The  paper  by  Reif  and  Heller  [1982]  is  a  prescriptive  piece.  They 
lay  out  a  teaching  methodology  for  physics  based  on  the  general  prob¬ 
lem  findings  in  cognitive  psychology.  They  outline  a  strategy  for 
structuring  knowledge  and  acquiring  knowledge  in  physics.  They 
present  a  detailed  program  for  physics  instruction.  There  is  no  empir¬ 
ical  validation,  but  they  do  try  to  tie  the  points  stated  in  their  recom¬ 
mendations  into  previous  empirical  work. 

A  series  of  papers  by  Feldhusen  et.  al.  [1972,  1975,  1979,  and 
1980],  Houtz  et.  al.  [1973]  and  Speedie  et.  al.  [1973]  covers  research 
done  in  general  problem  solving  in  education  at  Purdue  University. 
The  work  developed  a  measure  of  problem  solving  ability  appropriate  for 
elementary  school  children  from  different  socioeconomic  and  cultural 
backgrounds.  Because  of  the  age  of  the  students  involved,  this  work 
is  not  relevant  to  this  report.  One  interesting  thing  about  this  series 
of  papers.  They  point  up  the  isolation  of  the  education  literature  from 
other  research  in  problem  solving.  It  is  not  until  the  1979  paper  in  the 
series  that  any  work  by  Simon  is  mentioned.  Most  of  the  references 
are  to  educational  journals.  The  papers  themselves  are  heavy  with  ed¬ 
ucational  jargon  that  helps  hide  their  lack  of  useful  content. 

A  paper  by  Thorsen  [1977]  discusses  the  use  of  simulation  to  teach 
problem  solving  approaches  at  Denison  University.  The  paper  itself  is 
a  short  survey  of  the  problem  solving  literature  followed  by  arguments 
justifying  the  use  of  simulation  for  the  teaching  of  problem  solving. 
The  article  has  little  to  say  about  the  teaching  of  problem  solving.  It 
does  not  even  tell  us  whether  the  experiment  was  successful  or  what 
might  constitute  success  or  failure. 

A  paper  by  Baird  [1983]  offers  an  interesting  summary  of  the  prob¬ 
lem  solving  research  in  education.  Baird's  report  is  similar  to  ours  in 
that  he  is  surveying  the  literature  to  see  what  has  been  done  in  prob¬ 
lem  solving  and  what  benefits  may  result  from  teaching  problem  solving. 
He  concludes  that  the  benefits  from  teaching  generic  problem  solving 
are  difficult  to  prove.  He  believes  that  general  problem  solving  tech¬ 
niques  are  probably  most  effective  when  they  are  integrated  into  domain 
specific  courses. 


I.  Recognition,  Clarification  and  Understanding  of  the  Problem. 

1.  Read  the  problem  carefully. 

2.  Look  up  any  words  you  do  not  understand. 

3.  What  is  the  unknown?  What  are  the  data?  What  is  the 

condition?  What  is  given? 

4.  State  the  problem  in  your  own  words. 

5.  Break  the  problem  into  parts. 

6.  Draw  a  diagram  to  aid  in  clarification. 

7.  Accept  or  reject  the  specific  problem  tools  as  a  problem 

for  yourself. 

II.  Plan  of  Attack  -  Analysis 

1.  Gather  data  (facts,  rules,  relationships)  which  are 

necessary  for  solution. 

2.  Recall  missing  data,  select  relevant  data  from  the 

problem  statement,  and  generate  new  data  if  necessary. 

3.  Eliminate  irrelevant  data.  , 

4.  Decide  on  needed  approach  activities  by  noting  obstacles 

to  the  solution  of  the  problem. 

f 

III.  Productive  Phase 

1.  Find  the  connection  between  the  data  and  the  unknown. 

You  may  have  to  consider  auxiliary  problems  if  an 
immediate  connection  cannot  be  found.  Do  you  know  a 
related  problem? 

2.  Generate  a  hypothesis  or  a  number  of  alternative 

hypotheses  (possible  solutions  of  the  problem) . 

3.  Order  your  data  in  preparation  for  hypothesis  testing. 

4.  Reject  initial  hypotheses  that  do  not  satisfy  the 

conditions  of  the  problem. 

5.  Select  a  remaining  hypothesis  for  testing. 

6.  Construct  an  algorithm  or  develop  a  heuristic  for  the 

manipulation  of  data  as  an  instrument  for  possible 
verification  of  a  hypothesis. 

IV.  Validating  Phase  -  Checking  -  Proving 

1.  Accept  or  reject  the  hypothesis  by  verifying  or  not 

verifying  that  it  meets  the  conditions  of  the  task. 

2.  Look  back.  Can  you  check  the  result?  Can  you  check  the 

argument?  Can  you  derive  the  result  differently?  Can 
you  use  the  result  or  the  method  for  some  other  problem? 

3.  If  you  have  rejected  your  hypothesis,  select  a  remaining 
one  for  testing. 


Figure  9:  General  Heuristic  Problem  Solving  Procedure  -  Post 
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Another  factor  that  we  feel  is  important  is  the  teacher.  The  in¬ 
structor  of  this  course  should  be  a  first  rate  teacher  with  a  good  grasp 
of  the  principles  and  goals  of  the  course.  Hayes  is  an  outstanding 
teacher  (based  on  the  author's  personal  experience).  He  knows  the 
subject,  he  has  a  relaxed  and  supportive  style,  and  he  is  able  to  draw 
on  wide  experience  for  relevant  examples.  These  are  essential  points 
when  one  is  trying  to  present  material  that  is  out  of  the  ordinary. 
Some  effort  has  to  be  made  to  sell  the  students  on  the  usefulness  of  the 
course. 


5.2  OTHER  EDUCATIONAL  RESEARCH  IN  GENERAL  PROBLEM 
SOLVING 

There  is  a  small  literature  in  educational  research  in  the  study  of 
general  problem  solving.  It  does  not  seem  to  be  an  area  that  has  at¬ 
tracted  widespread  interest  when  compared  with  the  literature  on  more 
conventional  subjects  like  mathematics  or  reading).  One  article  by  Post 
and  Brennan  [1976]  dealt  with  an  experiment  in  teaching  geometry  to 
two  groups  of  tenth  grade  students. 

The  authors  developed  a  test  of  problem  solving  ability  and  adminis¬ 
tered  it  as  both  a  pretest  and  a  posttest  to  two  groups  of  tenth  grad¬ 
ers.  One  group  had  received  instruction  in  the  General  Heuristic 
Problem  Solving  Procedure  (presented  in  Figure  9)  while  the  other  did 
not.  The  reader  should  compare  the  model  in  Figure  9  with  that  of 
Polya's  in  Figure  1.  The  two  are  similar,  although  Post  and  Brennan 
do  not  cite  Polya.  The  two  groups  did  not  show  any  significant  differ¬ 
ence  in  problem  solving  ability.  The  authors  offer  a  detailed  discussion 
of  the  statistical  methodology  they  used.  This  discussion  would  be  ap¬ 
propriate  for  a  beginning  experimental  methods  course.  Unfortunately, 
they  tell  us  nothing  about  how  the  problem  solving  methodology  was 
taught.  Were  students  merely  exposed  to  it?  Did  they  get  substantial 
practice  with  it?  These  are  questions  left  unanswered.  The  conclu¬ 
sions  in  the  article  are  too  strong  to  be  justified  by  the  material  pre¬ 
sented  . 


Raaheim  and  Kaufmann  [1974]  tested  73  secondary  school  students 
using  tests  of  the  subjects'  ability  to  manipulate  their  environment.  In 
one  test,  the  subjects  were  asked  to  tell  how  to  save  a  kitten  stranded 
at  the  top  of  a  tree.  The  lowest  branch  on  the  tree  was  too  high  to 
reach.  The  tools  that  they  had  available  were  a  strong  drill,  a  hammer, 
a  pair  of  pliers  and  a  plane.  The  "best"  solution  involved  drilling 
holes  in  the  tree  trunk  and  then  using  the  hammer,  pliers  and  even  the 
drill  as  "steps"  to  climb  the  tree.  There  were  other  tests  in  a  similar 
vein.  They  seemed  to  test  the  subjects'  ability  to  overcome  functional 
fixity  in  solving  problems. 


1.  Problem  Solving  Theory  and  Practice 


a)  Understanding  Problems:  The  Process  of  Representation. 

b)  Search 

c)  Protocol  Analysis 

Memory  and  Knowledge  Acquisition 

a)  The  Structure  of  Human  Memory 

b)  Using  Memory  Effectively 

c)  Learning  Strategies 

Decision  Making  , 

a)  Getting  the  Facts  Straight:  Making  Decisions  in  a  Complex 
World . 

b)  The  Luck  of  the  Draw:  Dealing  with  Chance  in  Decision  Making 

c)  Cost-Benefit  Analysis 

Creativity  and  Invention  ^ 

a)  Cognitive  Processes  in  Creative  Acts 

b)  How  Social  Conditions  Affect  Creativity 


Figure  8:  Outline  -  The  Complete  Problem  Solver 


Without  adequate  practice,  the  whole  thing  is  a  meaningless  exercise. 
This  means  that  it  would  be  necessary  to  choose  a  set  of  problems  de¬ 
signed  to  emphasize  the  points  presented  in  the  course.  The  problems 
should  probably  be  from  domains  of  interest  to  the  student.  This 
means  that  "silly"  problems  (Tower  of  Hanoi,  Missionaries  and  Canni¬ 
bals,  etc.)  should  probably  be  kept  to  a  minimum.  Some  of  these 
problems  could  be  used  to  introduce  the  general  nature  of  the  problem 
solving  process,  but  after  that,  examples  that  are  relevant  to  the  stu¬ 
dents'  interests  would  be  best. 
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Carnegie-Mellon  University  Department  of  Psychology 


Psychology  85-113  -  Psychology  of  Learning  and  Problem  Solving 

A  course  aimed  at  increasing  students'  learning  and  problem 
solving  skills  through  understanding  and  applying  topics  in 
cognitive  psychology.  Topics  covered  will  include  representing 
problems,  searching  for  solutions,  making  decisions,  learning, 
use  of  technical  reasoning.  Considerable  emphasis  will  be 
placed  on  learning  and  problem  solving  in  the  physical  sciences. 


UCLA  School  of  Engineering 

Engineering  11  -  Patterns  of  Problem  Solving 

An  introduction  to  patterns  of  reasoning  in  the  process  of 
problem  solution  and  decision  making.  Exposure  to  concepts, 
theories  and  techniques  in  the  analysis  and  synthesis  of  total 
systems  in  our  complex  technological  civilization. 


Figure  7:  Course  Descriptions  in  Problem  Solving 


with  decision  making.  It  discusses  the  structuring  of  decision  problems 
and  their  impact  on  decisions.  It  also  presents  some  statistical  decision 
theory  and  cost-benefit  analysis  as  examples  of  decision  structuring 
tools.  The  last  section  is  on  creativity.  It  analyzes  the  sources  of 
creativity  and  conditions  affecting  creativity.  The  book  is  written  at  a 
level  that  is  appropriate  for  undergraduates. 

During  our  visit  to  San  Diego,  we  discussed  the  course  with  Hayes. 
He  felt  that  it  was  working  well  after  many  years  of  experimentation 
and  change.  He  also  felt  that  the  course  was  finally  to  the  point  where 
it  was  exportable  to  other  institutions.  Several  different  instructors 
had  taught  the  course  at  Carnegie  with  reasonable  success.  There  has 
been  no  formal  validation  of  the  course.  Hayes  said  that  he  receives  a 
gratifying  amount  of  positive  feedback  from  former  students.  He  would 
like  to  perform  a  formal  evaluation  of  his  course,  but  has  not  had  the 
time  or  resources  to  do  so. 

One  important  point  that  Hayes  emphasized  about  +'  's  course  was 
the  need  for  practice  in  the  problem  solving  techniques  presented. 


LEARNING  TO  APPLY  GENERAL  PROBLEM  SOLVING 

TECHNIQUES 


The  study  of  problem  solving  has  not  made  a  large  impact  on  educa¬ 
tion  yet.  This  is  not  surprising.  Education  is  a  conservative  field  and 
is  not  quick  to  embrace  fundamental  changes  even  when  they  are  of 
proven  benefit.  The  so  called  New  Math  involved  mathematical  ideas 
that  were  about  a  century  old  when  they  were  introduced.  General 
problem  solving  is  on  nowhere  near  as  sound  a  footing  as  the  material 
in  the  New  Math. 


5.1  SURVEY  OF  TEACHING  GENERAL  PROBLEM  SOLVING 

There  are  few  courses  in  general  problem  solving  taught  at  the  uni¬ 
versity  level.  We  found  documentation  on  two  and  have  heard  of  oth¬ 
ers.  The  first  course  on  which  we  have  information  is  taught  by  John 
R.  Hayes  of  the  Department  of  Psychology  at  Carnegie-Mellon  University 
and  the  other  is  taught  by  M.  F.  Rubenstein  of  the  School  of  Engi¬ 
neering  at  UCLA.  The  course  descriptions  are  given  in  Figure  7. 

We  have  no  firsthand  knowledge  of  these  courses,  although  we 
spoke  to  Hayes  about  the  course  at  Carnegie.  The  course  has  been 
taught  for  several  years  now  and  has  settled  down.  It  is  offered  to 
entering  students  early  in  their  career.  Hayes  has  written  a  book*  to 
support  the  course.  The  book  is  best  described  as  an  applied  cognitive 
psychology  text.  It  is  divided  into  four  sections.  An  outline  of  the 
topics  is  given  in  Figure  8.  The  first  section  deals  with  general  search 
strategies.  It  tries  to  get  the  reader  to  see  the  general  features  of  a 
problem  instead  of  trying  to  reproduce  a  book  solution.  The  second 
section  deals  with  the  classical  cognitive  psychology  view  of  memory 
structure.  It  also  offers  strategies  for  structuring  knowledge  (mne¬ 
monics,  time  lines,  etc.)  that  allow  a  student  to  acquire  knowledge 
without  trying  to  resort  to  simple  cramming.  The  third  section  deals 
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Constraints  may  be  externally  imposed.  All  we  need  to  do  is  have 
the  wit  to  recognize  them.  Eisenhower's  D-Day  decision  had  many  ex¬ 
ternally  imposed  constraints.  The  invasion  had  to  take  place  in  1944 
for  political  reasons.  It  had  to  be  in  the  Spring  to  allow  the  Allies  to 
take  maximum  advantage  of  good  weather.  There  were  only  a  few  days 
in  the  Spring  that  allowed  the  right  combination  of  tides  for  a  landing. 
All  these  constraints  helped  bound  the  problem  and  reduce  an  unstruc¬ 
tured  design  problem  to  a  structured  problem. 

We  have  to  be  careful  not  to  introduce  unnecessary  constraints  in  a 
problem.  This  is  the  case  in  the  problem  of  the  six  toothpicks  posed 
earlier.  Subjects  add  a  constraint  that  the  solution  be  confined  to  two 
dimensions  that  makes  the  problem  impossible  to  solve.  This  type  of 
thinking  gets  in  the  way  of  innovative  problem  solving,  but  it  is  prob¬ 
ably  necessary.  The  addition  of  constraints  makes  the  search  process 
manageable  and  speeds  up  problem  solving.  At  some  point,  it  may  be 
necessary  to  back  up  and  remove  constraints.  This  usually  proves  to 
be  hard  to  do.  The  problem  solvers  we  refer  to  as  "geniuses"  are  usu¬ 
ally  the  people  who  have  this  ability. 


4.3.2  Limitations  of  Models 

We  must  keep  the  limitations  of  models  in  mind.  A  model  is  not  the 
real  world.  It  is  only  an  abstraction  of  that  world.  A  model  must  be 
validated  against  an  external  reality.  When  we  do  this  with  most  mod¬ 
els,  we  find  that  it  has  a  limited  domain  of  applicability.  There  is 
nothing  wrong  with  this.  But,  it  does  mean  that  we  should  sometimes  go 
back  and  examine  the  constraints  we  have  accepted  by  using  the  model. 

It  is  important  to  realize  that  the  choice  of  models  is  a  choice.  It  is 
not  something  that  must  be  accepted  without  question.  Our  representa¬ 
tion  of  a  problem  offers  both  advantages  and  disadvantages.  Students 
must  realize  this.  Often,  they  have  invested  so  much  effort  in  learning 
a  model  that  they  are  reluctant  to  abandon  it.  A  problem  solving 
course  would  have  to  develop  techniques  to  encourage  students  to  move 
freely  between  different  models  of  problems  and  to  be  creative  in  mak¬ 
ing  up  their  own  representations.  This  is  one  of  the  things  that  DeBo- 
no  tries  to  do  in  his  approaches  to  problem  solving,  and  it  is  probably 
worth  doing.  The  inability  to  see  representations  as  arbitrary  is  prob¬ 
ably  one  factor  inhibiting  transfer  of  learning  in  problem  solving. 
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DIRECTIONS  FOR  FUTURE  RESEARCH  AND 
DEVELOPMENT 


The  usefulness  of  teaching  general  problem  solving  is  not  fully  es¬ 
tablished.  The  literature  surveyed  in  this  research  shows  some  interest 
and  activity  in  the  area.  Compared  to  thirty  years  ago,  there  has  been 
a  sizeable  increase  in  interest.  This  increase  was  initially  started  by 
work  in  artificial  intelligence  and  cognitive  psychology  in  the  1950's. 
In  the  1970's  and  1980's,  the  influence  began  to  be  felt  ,in  education. 
In  addition,  the  growth  of  interest  in  artificial  intelligence  and  expert 
systems  is  likely  to  mean  increasing  stress  on  the  study  of  problem 
solving . 

The  value  of  teaching  general  problem  solving  is  likely  to  remain 
unproved  for  some  time.  It  is  unclear  whether  the  subject  can  be 
taught  successfully.  All  during  our  education,  we  learn  to  solve  specific 
problems,  not  general  ones.  Our  education  forces  us  to  think  of  do¬ 
main  specific  problem  solving.  There  may  be  transfer  of  problem  solv¬ 
ing  skills  from  one  area  to  another  (this  is  the  normal  justification  for 
teaching  liberal  arts),  but  this  remains  unproved  as  well.  The  litera¬ 
ture  in  this  area  is  too  sketchy  to  be  able  to  give  a  definitive  answer. 


6.1  PROBABABLE  USEFULNESS  OF  TEACHING  PROBLEM  SOLVING 

Much  of  the  discussion  and  activity  in  the  teaching  of  general  prob¬ 
lem  solving  would  appear  to  be  based  only  on  the  hope  that  it  can  help. 
Some  research  is  openly  critical  of  the  usefulness  of  general  problem 
solving  instruction  [Post  and  Brennan,  1976].  Other  work  is  more  op¬ 
timistic  [Reif  and  Heller,  1982;  Thorson,  1977]  but  it  is  still  largely 
unvalidated.  During  our  conversations  with  Hayes  in  San  Diego,  he 
stated  that  there  is  little  or  no  validation  of  the  work  he  and  others 
have  done.  What  validation  exists  is  casual,  based  on  fragmentary 
feedback  from  former  students.  He  would  like  to  conduct  formal  valida¬ 
tion  of  the  course,  but  has  not  had  the  time  or  resources  so  far  to  do 
this . 
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It  would  be  useful  for  Naval  officers  to  have  some  exposure  to  the 
theory  of  problem  solving  if  only  because  this  area  is  a  basis  for  the 
so  called  "expert  systems"  that  are  becoming  become  increasingly  impor¬ 
tant.  A  background  in  the  techniques  used  in  general  problem  solving 
and  artificial  intelligence  would  be  helpful  in  understanding  these  sys¬ 
tems.  This  could  be  useful  even  if  the  student's  own  problem  solving 
ability  were  not  substantially  improved. 


6.2  TEACHING  PROBLEM  SOLVING 

The  inescapable  fact  remains  that  problem  solving  is  wedded  to  a 
choice  of  domain.  It  is  difficult  for  people  to  get  from  their  domain 
specific  knowledge  to  any  kind  of  overview  of  the  problem  solving  pro¬ 
cess.  It  has  only  been  comparatively  recently  that  people  did  research 
on  the  subject  of  problem  solving  in  general  apart  from  ^  specific  do¬ 
main. 

Much  of  the  material  that  is  supposed  to  be  "general"  in  fact  begins 
to  seem  domain  specific  when  yoL  look  at  it  closely.  It  usually  includes 
such  things  as  thinly  disguised  logical  puzzle  or  mathematical  problems. 
Hayes'  book  has  many  problems  of  this  type.  This  approach  is  prob¬ 
ably  useful  for  well  defined  problem.  The  well  defined  problems  may  be 
more  typical  of  problems  like  computer  program  debugging,  electrical  or 
mechanical  troubleshooting,  etc.  These  problems  are  ones  in  which  we 
already  have  a  problem  and  a  representation.  The  rules  for  manipulat¬ 
ing  the  representation  are  well  known.  For  this  kind  of  problem, 
teaching  general  search  heuristics  may  well  be  beneficial.  Good  problem 
solvers  in  these  domains  already  know  these  heuristics,  but  teaching 
the  heuristics  to  beginners  might  help  shorten  the  learning  time  re¬ 
quired  to  achieve  competence. 

These  search  heuristics  are  less  likely  to  be  useful  where  the  prob¬ 
lem  is  ill-defined.  In  this  type  of  problem,  the  first  phase  of  problem 
solving  is  a  design  component.  It  is  necessary  to  decide  what  the 
problem  is  and  to  select  or  create  a  representation  for  it.  It  would 
probably  be  more  useful  to  teach  techniques  for  selecting,  defining  and 
representing  problems.  The  approaches  used  by  DeBono  and  others 
might  be  useful  here.  The  elaborate  search  heuristics  may  be  less  use¬ 
ful  for  ill-defined  problems.  Many  management  problems  would  best  be 
characterized  as  ill-defined. 
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6.3  VALIDATING  RESULTS 


For  any  work  in  teaching  general  problem  solving,  a  major  problem 
is  going  to  be  validation  of  the  results.  We  were  not  able  to  find  any 
generally  accepted  measures  of  problem  solving  ability  applicable  to  a 
population  of  college  educated  adults.  The  work  we  came  across  was 
geared  toward  grade  and  high  school  students.  This  work  also  tends 
to  be  oriented  toward  well-defined  rather  than  ill-defined  problems. 
These  problems  are  easier  to  measure  and  easier  to  achieve  agreement 
on  standards  for  success. 

If  one  wishes  to  teach  generic  problem  solving  as  a  basic  subject  at 
this  level,  it  will  be  necessary  to  develop  measures  of  problem  solving 
ability.  This  will  not  be  easy  to  do.  It  may  well  prove  impossible  to 
find  measures  that  do  not  discriminate  in  favor  of  cultural  or  domain 
specific  skills.  It  has  proven  difficult  to  create  measures  of  general 
intelligence.  It  is  likely  to  be  even  more  difficult  to  create  widely  ac¬ 
ceptable  measures  of  general  problem  solving  ability. 


6.4  FUTURE  WORK  IN  TEACHING  GENERAL  PROBLEM  SOLVING 

General  problem  solving  may  be  too  nebulous  a  term  the  things 
we  have  been  discussing  here.  A  better  term  might  be  "learning  strat¬ 
egies"  since  this  is  the  focus  of  work  like  Hayes  and  Rubenstein.  It 
seems  that  future  work  in  this  area  should  proceed  slowly  and  deliber¬ 
ately.  It  should  involve  both  curriculum  development  and  basic  re¬ 
search.  The  curriculum  development  could  provide  a  course  to  serve  as 
a  vehicle  for  testing  theories  turned  up  in  research.  The  available  lit¬ 
erature  does  not  support  the  idea  that  general  problem  solving  is  a 
subject  suitable  for  inclusion  in  standard  training  sequences  or  core 
courses. 

One  point  that  Hayes  emphasized  strongly  was  that  it  was  not 
enough  to  lay  out  principles  of  general  problem  solving  and  expect  the 
students  to  pick  them  up.  Good  examples  and  practice  are  required. 
This  is  one  reason  that  it  is  likely  to  be  difficult  to  set  up  a  "general" 
problem  solving  course.  Most  course  material  is  oriented  to  demonstrat¬ 
ing  the  techniques  involved  in  a  particular  discipline.  There  is  usually 
little  effort  made  to  illustrate  general  principles  or  give  help  in  apply¬ 
ing  them.  New  course  material  would  have  to  be  developed. 

A  course  in  general  problem  solving  would  have  to  be  carefully  de¬ 
signed.  Adult  students  are  more  likely  to  respond  to  domain  specific 
material.  This  would  make  them  feel  that  the  course  was  relevant  to 
their  interests  and  probably  make  them  more  enthusiastic  about  learning 
the  material. 
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6.5  DIRECTIONS  FOR  FUTURE  RESEARCH 


There  is  a  need  for  both  theoretical  and  applied  research  in  problem 
solving.  Topics  of  interest  include: 

1.  Design  of  measures  of  problem  solving  skills.  Most  measures  in 

use  currently  are  aimed  at  younger  students.  They  are  also 
aimed  at  well-defined  problems  and  domain  specific  skills.  Some 
,  broader  measures  of  problem  solving  ability  are  required. 

2.  Design  of  course  modules  in  problem  solving  covering  both  do¬ 

main  specific  and  general  skills.  The  needs  of  the  Navy  in¬ 
volve  both  education  and  training.  Practice  with  courses  ap¬ 
propriate  to  both  areas  is  required. 

3.  Experiments  where  the  usefulness  of  teaching  problem  solving 

skills  is  tested.  Once  the  courses  and  measures  of  ability  are 
in  place,  they  must  be  debugged. 

4.  Studies  of  computers  and  human  problem  solving.  These  should 

focus  on  the  computer  as  a  problem  environment  and  ways  in 
which  the  computer  can  aid  human  problem  solving.  The  per¬ 
vasiveness  of  computers  in  our  environment  makes  it  essential 
that  we  develop  a  better  understanding  of  the  ways  in  which 
people  use  them. 
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